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EDITORS’ WORD 


Dear Readers, 


We hope you have all been doing well. This issue is focused on 
kernels. We will start with “An Outsider Perspective on Uniker- 
nels” by Hamza Sheikh. Russell Pavlicek will than explain you, 
how to “Understand Unikerlnes”. What do you think about uniker- 
nels yourself? 


Next, David Carlier will introduce you to “Kernel and Syscalls”. 
We would also like to share with you the first module of David's 
online course “Developing FreeBSD Kernel Modules”. We took 
down this course from the web page because materials were not 
completed, but the ones we have are very good and we would 
like to share them with you. If you are interested in learning “How 
to Upgrade OpenBSD and Build a Kernel”, you have to take a 
look at Bob Cromwell's article. You will love it! 


iXsystems shared an article about “Maxing Out Storage Perform- 
ance with ZFS Caching” with us this month. Mark VonFange al- 
ways has something ready for you ;) 


The fifth installment of “Model View Whatever” series will be fo- 
cused on “Dolphin Smalltalk MVP”. Damian Czernous will evalu- 
ate “More vs less important view logic’. 


In this issue you will find one interview. We spoke with Giuseppe 
Canale about cyber security, Windows 10, being an expert and 
about open source, of course. 


In the end, as always, is Rob’s column and his point of view on 
the Panama Papers leak. What do you think about it? Has your 
country been mentioned in the many articles that have come 
out? 


We would like to highly recommend you take a look at our online 
courses, especially if you liked the first module of “Developing 
FreeBSD Kernel Modules”. We have three more online courses 
that you can still join and one that is slowly being prepared ;) 


Also, we would like to thank all of you who contacted us after 
Marta's message to you. We have gotten so many responses! 
Next BSD Mag issue belongs to you! 


Have a nice April! 


Marta & BSD Team 
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BSD World Monthly News 6 


by Marta Ziemianowicz 


This column presents the latest news coverage of 
breaking news events, products releases and trend- 
ing topics. 


Unikernels 
An Outsider Perspective on Unikernels 17 


by Hamza Sheikh 


| have read The Rise and Fall of the Operating Sys- 
tem by Dr. Antti Kantee as well as Unikernels are Un- 
fit for Production by Bryan Cantrill. As an outsider, | 
have much to learn about Unikernels. | also don't 
have a horse in the race yet. For me, this is a very 
academic debate on the pros and cons, today and in 
the next decade, of Unikernels. 


Understanding Unikernels 20 
by Russell Pavlicek 


When we describe a typical operating system kernel 
on a typical machine (be it physical or virtual), we 
are normally talking about a distinct piece of software 
which runs in a separate processor mode (kernel 
mode) and address space from the rest of the soft- 
ware running on that machine. 


The FreeBSD Corner 


Kernel and syscalls - Introduction 26 
by David Carlier 


In this article, we will have an overview of what is 
called a syscall (system call shortened), from the ker- 
nel side to the userland, then in the end how to cre- 
ate a new one in FreeBSD. It is assumed you know 
how to build FreeBSD current and have some knowl- 
edge of C language. 


FreeBSD Kernel Module 1 39 
by David Carlier 


In this module, we will give an overview of the nature 
of the FreeBSD kernel. The important configuration 
files will be explained in addition to learning how to 
compile the whole system with more options, with 
more debugging information. Very useful for kernel 
development. 


OpenBSD 


How to Upgrade OpenBSD and Build a 
Kernel 53 


by Bob Cromwell 


Let's see how to upgrade your OpenBSD system. 
Maybe you are doing this because the latest release 
just came out. If so, this is pretty simple: back up your 
data, boot from install media, and select "Upgrade" 
instead of "Install". But maybe the latest release has 
been out for a few months. Why would we go through 
the trouble of building and installing a new kernel or 
other core system components? Maybe some 
patches have been released to improve system secu- 
rity or stability. It is pretty easy to build and install a 
kernel on OpenBSD, easier and simpler in many 
ways than it is on Linux. 


FreeNAS 


Maxing Out Storage Performance with ZFS 
Caching 68 


by Mark VonFange 


One of the more beneficial features of the ZFS filesys- 
tem is the way it allows for tiered caching of data 
through the use of memory, read and write caches. 
By optimizing memory in conjunction with high speed 
SSD drives, significant performance gains can be 
achieved for your storage. The first level of caching in 
ZFS is the Adaptive Replacement Cache (ARC), 
which is composed of your system’s DRAM. It is the 
first destination for all data written to a ZFS pool, and 
it is the fastest (i.e. lowest-latency) source for data 
read from a ZFS pool. When data is requested from 
ZFS, it looks first to the ARC; if it is there, it can be 
retrieved extremely quickly (typically in nanoseconds) 


and provided back to the application. 
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Model View Whatever - Dolphin Smalltalk 
MvP. 71 


by Damian Czernous 


The Dolphin Smalltalk is a version of Smalltalk lan- 
guage dedicated to the Windows platform. The 
Smalltalk language comes with a widget library done 
with the Model View Controller (MVC) structure. Dol- 
phin, however, deviates from that path. 


Interview 

Interview _with Giuseppe Canale from Escom 
Net 80 
by Marta Ziemianowicz, Marta Strzelec & Marta Si- 
enicka 

Rob’s Column 85 


by Rob Somerville 


The International Consortium of Investigative Journal- 
ists, German newspaper Suddeutsche Zeitung, as 
well as more than 100 other news organizations, 
have caused an international storm by releasing the 
Panama Papers this week. There is a very large fly 
in this ointment however. Why is this 2.6 Tb dataset 
of over 11 million documents not being released in 
its entirety? 
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BSD Certification 


The BSD Certification Group Inc. 
(BSDCG) is a non-profit organization 
committed to creating and 
maintaining a global certification 
standard for system administration 
on BSD based operating systems. 


@ WHAT CERTIFICATIONS ARE AVAILABLE? 


BSDA: Entry-level certification suited for candidates 
with a general Unix background and at least six months of 
experience with BSD systems. 


BSDP: Advanced certification for senior system administrators 
with at least three years of experience on BSD systems. 
Successful BSDP candidates are able to demonstrate 

strong to expert skills in BSD Unix system administration. 


g WHERE CAN | GET CERTIFIED? 


We’re pleased to announce that after 7 months of 
negotiations and the work required to make the exam 
available in a computer based format, that the BSDA 
exam is now available at several hundred testing centers 
around the world. Paper based BSDA exams cost $75 USD. 
Computer based BSDA exams cost $150 USD. The price of 
the BSDP exams are yet to be determined. 


Payments are made through our registration website: 
https://register.bsdcertification.org//register/payment 


@& WHERE CAN | GET MORE INFORMATION? 


More information and links to our mailing lists, LinkedIn 
groups, and Facebook group are available at our website: 
http://www.bsdcertification.org 


Registration for upcoming exam events is available at our 
registration website: 
https://register.bsdcertification.org//register/get-a-bsdcg-id 


New FreeBSD Foundation 
Logo 


The FreeBSD Foundation is pleased to an- 
nounce the debut of our new logo and web- 
site, signaling the ongoing evolution of the 
Foundation identity and ability to better serve 
the FreeBSD Project. Our new logo was de- 
signed to not only reflect the established and 
professional nature of our organization, but 
also to represent the link between the Project 
and the Foundation, and our commitment to 
community, collaboration, and the advance- 
ment of FreeBSD. 


FreeBSD 


FOUNDATION 


https://www.freebsdnews.com/2016/03/25/ne 
w-freebsd-foundation 
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FreeNAS Mini XL Now Available 


New and Improved Device Offers Greater Storage Capacity, Perform- 
ance Than Its Predecessor 


SAN JOSE, CA--(Marketwired - April 04, 2016) - iXsystems, the server, 
storage, and open-source technology company that develops FreeNAS, 
the world's most popular storage OS, today introduced the FreeNAS Mini 
XL Storage Device. The FreeNAS Mini XL is based on the same proven 
hardware used by the smaller FreeNAS Mini, but offers greater storage 
capacity and performance. Available today, the FreeNAS Mini XL can be 
purchased at iXsystems.com or from Amazon. 


Storage solutions like the FreeNAS Mini XL have become increasingly im- 
portant to users as technologies that allow for content capture and crea- 
tion become mainstream and intensive. More than ever, customers value 
solutions that allow for large amounts of storage that are fast and secure. 


The FreeNAS Mini XL will be offered in multiple configurations ranging from Diskless to 48TB. Us- 
ers configuring a Mini XL build through iXsystems.com have a variety of customizable options, in- 
cluding: read and write cache drives, different ECC DRAM capacities, and of course, storage con- 
figurations up to 48TB. 


"The FreeNAS Mini XL satisfies a long-standing customer need for twice the storage in a footprint 
not much larger than our highly popular FreeNAS Mini product," said Jordan Hubbard, CTO, ixX- 
systems. "Our customers are capturing 4K video, curating massive media libraries, and want a 
storage option that is fast and reliable. The Mini XL based on FreeNAS gives them that solution." 


FreeNAS Mini XL Key Features: 
e Power efficient Eight-Core 2.4GHz Intel CPU, drawing only 17 Watts 
e Hardware-accelerated ZFS disk encryption 
e 32GB of ECC memory, upgradeable to 64GB 
e Hot swap functionality with 8 tool-less, front loading drive bays 


e Capable of saturating dual Intel Gigabit LAN Ports, but can be upgraded to 10GbE if 
needed 


e Dedicated Remote Hardware Management Interface (IPMI) or option to share through 


on-board LAN 
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e Latest FreeNAS version installed and configured on dedicated, internal flash device 


e 3x USB 2.0 Ports (2 front, 1 rear), 1 x Serial Port (DB9), 1x VGA 


e Physical security: locking front bezel, latchable drive trays, and chassis lock eyelet (for 
cable or padlock) 


http://www.ixsystems.com/ 


“Mr. Linux” Of Oracle Joins Microsoft To Lead O 


Linux Efforts 


Microsoft's HR department has poached the man who turned Oracle into a Linux-dominated com- 
pany. Wim Coekaerts, commonly known as Oracle’s “Mr. Linux”, has joined Redmond folks to 
head up its Linux and open source efforts. 


This is an established fact that Microsoft loves Linux and open source technologies. The recent 
developments at Build Developer Conference 2016 will soon allow developers to use Ubuntu on 
Windows 10. 


In order to hasten the progress of Linux and open source projects at Redmond, the company’s 
HR department has stepped up its game. The software giant has reportedly poached Wim 


Coekaerts, commonly known as Oracle’s “Mr. Linux’. 


In the tech world, Coekaerts is well-known for his contribution to Linux projects and bringing the 
open source technology to Oracle. He also turned Oracle into a Linux distro-maker with the 
launch of Oracle Linux for the enterprise. 


Talking to ZDNet, Mike Neil, Microsoft's Corporate VP of the Enterprise Cloud has confirmed this 
news. 


“Wim Coekaerts has joined Microsoft as Corp VP of Open Source in our Enterprise Cloud Group. 
As we continue to deepen our commitment to open source, Wim will focus on deepening our en- 
gagement, contributions and innovation to the open-source community,” he said. 


Microsoft became involved with Linux since Satya Nadella became CEO, going as far as creating 
a custom Linux-based software for networking and Azure. 


The company hasn't said what parts of its open source efforts will be taken care of by Coekaerts, 
but it’s important to note that he is the person who turned Oracle into a company dominated by 
Linux-based technologies. 


http://fossbytes.com/mr-linux-wim-coekaerts-oracle-joins-microsoft-open-source/ 
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UbuntuBSD now available 


UbuntuBSD has been made available, and is currently in its 
BETA stage. This project aims to provide the Ubuntu user expe- 
rience on top of the FreeBSD kernel, with the goal of moving 
away from systemd. 


The ease and familiarity of Ubuntu with the rock-solid stability 
and performance of the FreeBSD kernel. 


This project is in BETA stage! It is production-ready in most 
cases but you could easily find some bugs. You have been 
warned. 


—izt Features 


e Versatile text based installer 


e Xfce desktop included 


e Ubuntu based 
e Debian based 
e FreeBSD based 
e Suitable for desktops and servers alike 
e ZFS support completely integrated 
https://www.freebsdnews.com/2016/03/25/ubuntubsd/ 


https://sourceforge.net/projects/ubuntubsd/ 


Free pilot's license for immutable infrastructure nuts 


Red Hat has cut the $99 price of its Linux developer subscription to zero, for penguins building 
cloud microservices using containers. 


The company today is expected to start giving away its Red Hat Enterprise Linux (RHEL) sub- 
scription for free as part of the existing Red Hat Developer Program. 
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The free license runs in tandem with the existing $99 developer license for those already paying, 
with Red Hat assessing whether it should continue charging. 


It follows the introduction of a free developer license for the JBoss application server, FUSE, 
Drools and BPM suite 18 months ago. 


Like these, the RHEL license applies only to development, not production environments. Unlike 
these, it's RHEL that's turned Red Hat into a profitable Linux vendor and the first past $1bn and 
then, last year, $2bn in revenue. 


While this targets devs, however, Red Hat's introduced the free license to ensure its Linux be- 
comes a player in continuous lifecycle management of cloud services. 


Red Hat wants to ensure RHEL gets used from dev and test through to production rather than, as 
can happen now, have devs start out using free CentOS or Fedora and then — potentially — switch 
to RHEL for production or — more likely — stay on the free stuff. 


It's that need to switch that introduces the risk of coding breaks, and that introduces migration 
hassles and is a conclusive factor in preventing lifecycle management. 


That's a no-no for today's meme du-jour of immutable infrastructure — servers build using code 
that you don't alter, but are built for purpose and get dumped if, or when, they're done with or get 
broken. Immutable infrastructure cannot work if there exist minute variations in different servers 
or different versions of the same server. 


One operating system all the way down the line is one possible way to avoid this. 


Announcing the free license, Red Hat also pointed out it's targeting those coding for Linux from 
Windows machines and Mac. 


Red Hat buddied up with Microsoft in November last year on cloud. RHEL, JBOSS and middle- 
ware would run natively on Microsoft's Azure cloud with plans for "full access to .NET across Red 
Hat technologies," Mower said. 


RHEL became the "primary development and reference operating system for .NET Core on 
Linux." ® 


http://www.theregister.co.uk/2016/03/31/red_hat_rhel_free_dev_license/ 
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Xamarin casts off commercial roots 


BUILD2016 Microsoft will make Xamarin tools and 
code, which enable compilation of Mac, Android 
and iOS applications using C#, free and open 
source, said corporate VP Scott Guthrie at the com- 
pany's Build conference under way in San Fran- 
CISCO. 


Announcing 


X Marin far Vie. 
aMarit Or Visual Studic 


BoeeouRS 


S0SE0EC 
PMO DEDEDE 


Xamarin's origins are with Mono, a project created 
by Miguel de Icaza as an open source and cross-platform implementation of Microsoft's C# lan- 
guage and .NET Framework. In 2011, Xamarin was cofounded by de Icaza and Nat Friedman, 
taking the Mono platform and making it a compiler for mobile apps targeting iOS and Android. 


Xamarin platform will now be free for Visual Studio users, including the free Community edition as 
well as Professional and Enterprise versions — drawing a big cheer from Build attendees. 


In addition, Guthrie said that Xamarin's code will be open source, under the management of the 
.NET Foundation, home of Microsoft's other open source developer projects including ASP.NET 
and .NET Core. 


Xamarin's iOS emulator remoted to Windows 
for debugging 


Miguel de Icaza also took the stage at Build, to 
show off a new feature: the ability to remote the 
iOS emulator to Windows in order to test and de- 
bug an iOS application in Visual Studio without 


*Viewidload(), 


1p .Regionc hanged 
ert 7 


Om any additional meee sae | | leaving the Windows desktop. A Mac is still re- 
a iS quired, since part of the compiler runs on Apple's 
OS X. 


Separately, Mono has been relicensed under the 
MIT license, which means it can now be used 
freely even in scenarios which would previously 
have required a commercial license. Mono is also 
being contributed to the ._NET Foundation. 


Microsoft's Xamarin strategy will boost usage of the tools and will further the company's ambition, 
announced yesterday at Build, to make Windows an all-purpose development platform. 
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That said, the preferred operating system of many mobile developers is the Mac, and while Micro- 
soft's announcements will do much to keep its own developer community using Windows, win- 
ning back Mac-using developers will be more challenging. 


Here's the thing though: it was open source guy de Icaza who took Xamarin closed source, and 
now it is Microsoft returning it to the community. Surprising times. ® 


http://www.theregister.co.uk/2016/03/31/xamarin_tools_code_free_and_open_source/ 


The OpenBSD Foundation 2016 Fundraising Campaign 


The OpenBSD Foundation needs your help to achieve our fundraising goal of $250,000 for 
2016. 


Reaching this goal will ensure the continued health of the projects we support, will enable us to 
help them do more, and will avoid the distraction of financial emergencies that could spell the end 
of the projects. 


2015 was a good year for the foundation financially, with funding coming almost equally from cor- 
porate and community donations. While the total was down significantly after 2014’s blockbuster 
year, we again exceeded our goal. 


As an individual or corporation, the best kind of donation we can receive is a recurring donation. 
This allows longer term planning on our part, instead of hoping for one time cash infusions. The 
easiest way for an individual to support us in this way is a recurring Paypal donation, which is our 
preference. 


Donations to the foundation can be made on our Donations Page. We can be contacted regard- 
ing corporate sponsorship at fundraising@openbsdfoundation.org 


rebels unleash spec to battle the Cloudera/MapR em 


https://osdmag.org/openbsd_found/ 
ODPi publishes runtime spec and test suite 


ODPi, the group formerly Known as the Open Data Platform initiative and set up last year as an 
attempt to standardise Hadoop applications, has published its first runtime specification. 


Backed by Hortonworks but kicked into the corner by heavyweights MapR and 
Cloudera, ODPi was set up last year to try an. make sure applications would work BSD 
3 


Instead of collapsing, however, the group quietly worked on a runtime specification accompanied 
by a test suite. 


The ODPi technical working group says its objectives are: 


e For consumers: ability to run any “ODPi-compatible” software on any “ODPi-compliant” 
platform and have it work. 


e For ISVs: compatibility guidelines that allow them to “test once, run everywhere.” 


e For Hadoop platform providers: compliance guidelines that enable ODPi-compatible 
software to run successfully on their solutions. But the guidelines must allow providers to patch 
their customers in an expeditious manner, to deal with emergencies. 


The runtime spec, at Github, doesn't preclude applications from calling private interfaces, but the 
authors note that customisation breaks the “test once, run everywhere” model. 


The current spec requires the Apache Hadoop 2.7 branch as a base spec. The “minimum native 
build” specifications set out requirements for Kerberos, Java and OS requirements, and the GZip 
and Snappy codec compression libraries. 


Apache Big Top is used for packaging, testing and configuration, and there are “guidelines on 
how to incorporate additional, non-breaking features, which are allowed provided source code is 
made available through relevant Apache community processes.” 


Sandbox images for testing are also at Github. ® 


http://www.theregister.co.uk/2016/03/29/nadoop_rebels_unleash_spec_to_battle_the_clouderam 
apr_empire/ 


en Source Hybrid Cloud Sends Red Hat Past 


Mark for 2016 


If there was any question about just how profitable an open source business can be, Red Hat 
(RHT) answered it this week by releasing financial reports that show it has become the first open 
source company to cross the $2B revenue threshold. 


The company's latest financial report, released March 22, shows revenue of $544M for the last 
quarter and $2.05B for fiscal year 2016 overall. That's up from $1.79B in annual revenue for FY 
2015. 


The increase is not at all a bad showing for a period during which the global economy remained 
sluggish and American companies like Red Hat faced a tough international market 


due to the strong dollar. 42 BSD 
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Red Hat said the growth reflected the success of its open source hybrid cloud products in particu- 
lar. "Enterprises increasingly adopting hybrid cloud infrastructures and open source technologies 
drove our strong results," said Jim Whitehurst, the company's CEO. "Customers are demanding 
technologies that modernize the development, deployment and life-cycle management of applica- 
tions across hybrid cloud environments. Many are relying on Red Hat to provide both the infra- 
structure and the application development platforms to run their enterprise applications consis- 
tently and reliably across physical, virtual, private cloud and public cloud environments." 


Going forward, Red Hat projects revenue of between $2.380B and $2.420B for the coming fiscal 
year. 


It's no secret that businesses can succeed by selling software whose source code is given away 
for free, or services related to it. Companies like Cygnus Solutions (which later merged with Red 
Hat) were profiting from free software as early as the 1980s. But Red Hat's crossing of the $2B 
threshold is a new milestone for the open source ecosystem. 


The figure might not be significant for larger vendors that don't focus exclusively on open source, 
but for a company that has invested everything in open source, it's a big deal. It's also good news 
for the open source sector of the channel as a whole, which can continue to count on strong per- 
formance at companies like Red Hat, which funds a great deal of open source development, to 
keep open source projects well-heeled. 


http://thevarguy.com/open-source-application-software-companies/open-source-hybrid-cloud-sen 
ds-red-hat-past-2b-revenue-ma 


VoCore: A Cheap And Coin-sized Linux Computer With Wi-Fi 


VoCore is an open hardware that runs 
OpenWRT Linux. This tiny computer comes 
with Wi-Fi, USB, 20+ GPIOs that will help you 
to make a smart home automation system or 
use it in other embedded projects. Read more 
to know about this device and grab one for your- 
self. 


VoCore Is Open Source With each passing day, mini computer boards 


are getting more and more popular. Single 

board computers like Raspberry Pi, CHIP, Oran- 
gePi, etc., are being endorsed by makers and DIY enthusiasts to create new innovations. How- 
ever, if you are looking for an even smaller Linux computer, VoCore is the perfect device for you. 


3 BSD 


Alpha Version: 25.4mm x 25.4mm x 3.6mm, four layers, blue PCB. 


Release Version: 25,6mm x 25.6mm x 3.6mm, four layers, white PCB. 
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At fossBytes, we love open source technolo- 
gies and so do the makers of VoCore. It’s an 
open source hardware that runs OpenWrt on 
top of Linux. With this mini Linux machine, 
you can fork your own Wi-Fi router, make 
smart home automation systems, invent a 
new device, build a motherboard and what- 
not. 


In simpler words, you can use it as a standa- 
lone device or use it as an embedded compo- 
nent of a larger system. It comes with in- 
cluded Dock that extends the USB and Ether- 
net ports to enhance its functionality. 


Specifications of VoCore Linux computer: 


This coin-sized computer is powered by 


32MB SDRAM, and 8MB SPI Flash. It provides many interfaces like 10/100M Ethernet, USB, 
UART, I2C, 12S, PCM, JTAG and over 20 GPIOs. 


OpenWRT Linux 
Onboard Wi-Fi adapter 


Integrates an 802.11n MAC, baseband, radio, FEM & 5-port 10/100Mbps Ethernet 
switch 


Processor: Ralink/Mediatek 360 MHz RT5350 MIPS 


Here’s the pin map of VoCore: 


An open source software and hardware of VoCore means that you will also get its full hardware 
design and source code. This will allow you to control every part of this tiny Linux computer. 


http://fossbytes.com/vocore-cheap-linux-computer-wi-fi-openwrt/ 
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Great Specials 


On FreeBSD® & PC-BSD® Merchandise 


229.95 


PC-BSD 9.1 DVD 


239.95 


FreeBSD 9.1 Jewel Case CD Set 


DVD 


or FreeBSD 9.1 


Give us a Call & ask about our 
COFTWARE BUNDLEG 


1.925.240.6652 


s49. 0 $99.95 


The PC-BSD 9.0 Users Handbook The FreeBSD CD or DVD Bundle 


PC-BSD 9.1 DVD inside each CD/DVD Bundle, you'll find 


Stylish Dress Attive 


. Comfy AppareL 

FreeBSD 9.1 Jewel Case CD/DVD... $39.95 
CD Set Contains: 

Disc 1 Installation Boot ef (i386 

Disc 2 Essential Packages Xorg (i386) 

Disc 3 Essential Packages, GNOME2 (i386) 

Disc 4 Essential Packages (i386 
FreeBSD 9.0 CD............. kthishesilaiiait seal iinet aes sisihdinede $39.95 
TRE LE BB GAORARSRRRREED rw doom fee ce rine rw AIO RE tay AER Rr $39.95 


FreeBSD Subscriptions 
Save time and $$$ by subscribing to regular updates of FreeBSD 


FreeBSD Subscription, start with CD 9.1 oo... ccscesscessesenssrrese $29.95 
FreeBSD Subscription, start with DVD 9.1 oo ccscsscesseneneeene 929,95 
FreeBSD Subscription, start with CD 9.0............. siliechdaanassonitia $29.95 
FreeBSD Subscription, start with DVD 9.0.0.0... cccsscsesseseseeses $29.95 
PC-BSD 9.1 DVD (Isotope Edition) 

PC-BSD 9.1 DVD... shidaiiselinemmean nena 
PC-BSD Subscription macrseine a ae 


Just Plasem Fue 


Bundle Specrals! 


T-Shirts 

The FreeBSD Handbook 

The FreeBSD Handbook, Volume 1 (User Guide) ....................539.95 
The FreeBSD Handbook, Volume 2 (Admin Guide)................ $39.95 
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An Outsider Perspective on 


Unikernels 


by Hamza Sheikh 


| have read The Rise and Fall of the Operating System by Dr. 
Antti Kantee as well as Unikernels are Unfit for Production 
by Bryan Cantrill. As an outsider, | have much to learn about 
Unikernels. | also don't have a horse in the race yet. For me, 
this is a very academic debate on the pros and cons, today 
and in the next decade, of Unikernels. 


Kantee writes: 


“Technology should encapsulate complex- 
ity and be optimized for the common case, 
not for the worst case, even if it means we, 
the software folk, give up the illusion of be- 
ing in control of hardware.” 


This is a hard idea to digest for me. In my 
Quality Assurance roles, | feel a deep desire 
to explore the worst case scenarios to get an 
understanding of when and how systems fail 
and their impact when they fail. For me, the 
happy path, the "common case" as Kantee 
writes, is to make sure systems don't regress 
during active development. The common case 
deserving more optimization goes against the 
grain of my approach. 


Systems don't exist in isolation anymore. In a 
networked world, there are many more 
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chances an individual system will fail because 
it interacts with the outside world. I'm inclined 
to optimize for recovering gracefully and also 
providing enough information to figure out the 
why and how of the failure. 


Kantee continues: 


“In other words, since the operating sys- 
tem does not protect the user from evil or 
provide powerful abstractions, it fails its 
mission in the modern world. Why do we 
keep on using such systems?” 


This is a very interesting observation. Cantrill 
makes a similar point about Unikernels, 
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“The organs that provide this kind of func- 
tionality have been deliberately removed 
from unikernels in the name of weight 
loss; any unikernel that provides suffi- 
ciently sophisticated debugging tooling to 
be used in production would be violating 
its own dogma.” 


They're both making the point that since a par- 
ticular system does not adhere to its own pur- 
pose or design it crosses the boundary into hy- 
pocrisy. Are we to throw out entire bodies of 
work because they are not pure enough? 


Kantee concludes: 


“Minimally implemented application sup- 
port is a few thousand lines of code plus 
the drivers, as we demonstrated with the 
Rumprun unikernel. Therefore, there is no 
reason to port and cram an operating sys- 
tem into every problem space. Instead, we 
can split the operating system into the “or- 
chestrating system” (which also has the 
catchy OS acronym going for it) and the 
drivers. Both have separate roles. The driv- 
ers define what is possible. The orchestrat- 
ing system defines how the drivers should 
work and, especially, how they are not al- 
lowed to work. The two paths should be in- 
vestigated relatively independently as op- 
posed to classic systems development 
where they are deeply intertwined.” 


This conclusion is important to keep in mind 
when reading Cantrill's post or thinking about 
Unikernels in general. 


Unikernels are a_ think-outside-the-box ap- 
proach to solving the problem of adapting to 
the various use cases (bare metal, cloud, mo- 


bile, desktop, etc.) by doing the minimum 
work necessary to get things running. As Can- 
trill points out, this sacrifices a lot of the tool- 
ing and experience gained in operations used 
to solve the same problems today. 


As evidenced by Rumprun, running existing 
applications unmodified requires sacrifices 
from the Unikernel. For example, POSIX stuff 
is still required for many applications. In addi- 
tion, in a perfect Unikernel-only world, a vast 
majority of applications will need to be rewrit- 
ten. As Cantrill points out, "There are no proc- 
esses" and "Good news: apps kinda work! 
Bad news: did we mention that they need to 
be ported?" 


Who out there is willing to learn a new para- 
digm of deploying applications that also re- 
quires them to rewrite them? Windows XP is 
still in use throughout the world even though it 
has been End of Life for a while now. Change 
is not easy, especially when there are huge 
monetary investments to be protected. 


This leads me to believe that Unikernels will 
be successful in niches. The size of these 
niches may be significant and that may attest 
to their success with time. Nevertheless, | 
don't see them taking over the world in the 
next decade. 


Unikernels also throw out the baby with the 
bath water. Instead of building on the ad- 
vances made in Operating Systems (OS) and 
tools, they rely on every application deciding 
how much of the OS work it is willing to reim- 
plement. 
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For example, debugging, monitoring, and 
other operational considerations are now the 
responsibility of each application, instead of 
the same applications using specialized work 
in the OS ecosystem in those areas. 


When | look at the maker and Internet of 
Things world, the world of Raspberry Pis and 
Arduinos, | like the idea of Unikernels a lot. 
They potentially provide only the things | need 
to get my single application running. This is 
why | think Unikernels are bound to shine in 
highly specialized niches. They are not going 
to replace my OS X anytime soon. 


Many of us have to run multiple applications 
simultaneously, many of which share libraries. 
These libraries are abstractions built upon 
other abstractions. Unikernels aim to get rid of 
these layers of abstractions and interfaces 
and provide a single-layered surface where, 
as | understand it, it's a giant ball of code com- 
piled together. The application is the OS and 
the OS is the application. | still can't wrap my 
head around the changes required in software 
development practices with this sea change. 


Unikernels have an uphill battle in convincing 
software practitioners that this radical idea will 
provide handsome dividends at some point. 
They are at an unfortunate disadvantage be- 
cause they either have to win at everything or 
they will be declared a failure. They are also 
burdened with casting off any crutches to 
make current applications run as soon as they 
can or else the purity of the entire idea will be 
questioned. It will be said, "If they need this 
idea and that thing and that other stuff from 
traditional OSes what's the big idea here any- 
ways?" 


I'm taking a wait and watch approach. | would 
love to be proven wrong in my assumptions 
and predictions. What | do know for sure is 
that as Unikernels mature and gain wider 
adoption, the debate will not only intensify but 
we will also witness their evolution. We will 
get a better idea of how some theoretical 
things are executed in practice and how well 
they are received. | look forward to following 
this technology. 


About the Author: 


A Linux escapee and FreeBSD user of less than a year. Started using BSDs with 
pfSense in 2007 and loved it. Day job involves a lot of Python and test automation. 
Evenings and weekends are devoted to family, FreeBSD, and Erlang. 
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Understanding Unikernels 


by Russell Pavlicek 


When we describe a typical operating system kernel on a 
typical machine (be it physical or virtual), we are normally 
talking about a distinct piece of software which runs in a 
separate processor mode (kernel mode) and address space 
from the rest of the software running on that machine. This 
operating system kernel generally provides critical low-level 
functions which are leveraged by the other software in- 
stalled on the box. The kernel is generally a generic piece of 
code which is trivially tailored (if at all) to the application 
software stack it is supporting on the machine. This generic 
kernel normally provides a wide range of rich functions, 
many of which may be unneeded by the particular applica- 
tions it is being asked to support. 


In fact, if you look at the total software stack 
on most machines today, it is often difficult to 
figure out just what application will be run on 
that machine. You are likely to find a wide 
swath of hundreds, if not thousands, of low- 
level utilities, plus multiple databases, a web 
server or two, and a number of specialized ap- 
plication programs. The machine may actu- 
ally be charged with running a single applica- 
tion, or it may be intended to run dozens simul- 
taneously. Careful analysis of the startup 
scripts will yield hints as to the final solution 
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set which will be run on the machine, but it is 
far from certain, as a suitably privileged user 
may elect to invoke any of a number of appli- 
cations present on the box. 


The Unikernel Difference 


The footprint of a unikernel-based machine, 
however, is quite different. A unikernel's role 
in a machine (or virtual machine image) is 
similar to that of other kernels, but the imple- 
mentation parameters are significantly differ- 


ent. BS D 
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For example, an analysis of a unikernel-based 
machine's code does not suffer from the ambi- 
guity of most other software stacks. When you 
look at a unikernel system, you will find one 
and only one application present. The multiple 
applications of a standard software stack are 
gone, as are the aforementioned plethora of 
generic utilities and support functions. 


But the trimming of excess doesn't stop there. 
Not only is the application stack trimmed to 
the bone, but the operating system functions 
are likewise reduced. For example, multi-user 
support is gone. Multiple process support is 
gone. Advanced memory management is 
gone. 


Think that's radical? Consider this: the whole 
notion of a separate operating system layer is 
gone as well! No longer is there a separate ad- 
dress space for the kernel and a separate ad- 
dress space for the application. Why? Be- 
cause the kernel functions and the application 
are now part of the same program. In fact, 
the entire software stack is comprised of a sin- 
gle software program, providing all needed ap- 
plication code and operating system func- 
tions. And, if that weren't enough, the operat- 
ing system functions contained in the uniker- 
nel provide only those functions needed to 
power the application in question — all other 
unneeded operating system functions have 
been removed entirely. 


A Software Stack Reflecting The Realities 
of a New Century 


This singularity of purpose is the radical re- 
think behind unikernels. For decades in this 
industry, we have worked with the concept 
that the best architecture for any machine is 
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to start with a generic multiuser operating sys- 
tem base, load on a wide array of useful utili- 
ties, add every application we might possibly 
want to use, and then top it off with some type 
of packaging software to manage this entire 
mess. 


Thirty-five years ago, this approach was en- 
tirely sensible. Hardware was expensive. Virtu- 
alization options were very limited or unavail- 
able. Security was limited to making sure the 
guy seated next to you in the computing cen- 
ter wasn't watching you type your password. A 
single machine had to handle many users run- 
ning many applications at the same time in or- 
der to be cost effective. When | was in college 
(a millennium or two ago), before the arrival of 
the personal computer, the college computer 
center had one insanely expensive machine 
(by today's standards) — a DEC PDP-11/34a, 
for the gray-headed who might care — 
equipped with 248 kilobytes (no, that's not a 
typo) of usable memory and 25 megabytes of 
disk space to support an entire campus of 
computer science, engineering, and mathe- 
matics students. That single machine had to 
service every function which a couple hun- 
dred students could think of in a given semes- 
ter. 


Compare that ancient dinosaur of computing 
history to a modern smart phone and you dis- 
cover that the phone has multiple orders of 
magnitude more computing power than that 
machine had. So why are we still creating ma- 
chine images using the same rules we used 
back in the computing stone age? Doesn't it 
make sense to rethink the software stack to 
match the new realities of computing? 
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In the modern world, hardware is cheap. Virtu- 
alization is omnipresent and efficient. And just 
about every computing device is connected to 
a vast worldwide network of potentially mali- 
cious hackers. Think about it: a DNS server 
really doesn't need gigabytes of bloat to do its 
job. An app server doesn't really need to have 
a thousand utilities available for the use of the 
desperado who just exploited a hole which 
gave him virtual command line access. Anda 
webserver doesn't need to validate the com- 
mand line logins of 500 different timesharing 
users. So why are we still using an archaic 
software stack concept which supports all 
these undesirable scenarios? 


The Brave New World of the Unikernel 


So what should a modern stack look like? 
How about this: a singular application image, 
virtualized, highly secure, ultra-lightweight, 
with incredibly fast startup times. That's some- 
thing that a unikernel can deliver. Let's break 
it down: 


A Singular Image: The hundreds of utilities 
and masses of applications layered on top of 
a generic kernel is replaced with a single ex- 
ecutable containing all the needed application 
and operating system code in a single image. 
It contains nothing more than what is needed. 


Virtualized: Just a few years ago, you'd be 
lucky to fit anything more than a handful of vir- 
tual machines on a single server. The limits in 
memory in hardware combined with the old- 
school, memory-hungry software stack simply 
didn't allow room for too many VMs to coexist 
on a single server at one time. With today's 
beefy servers equipped with many gigabytes 
of memory, we no longer need to settle for a 
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handful of VMs per server. If each VM image 
were small enough, we could run hundreds — 
or even thousands — of VM appliances simulta- 
neously on a single server. 


Secure: In the age of the cloud, we find mali- 
cious hackers routinely penetrating servers 
everywhere, even the servers of the largest 
corporations and government agencies. Such 
violations frequently exploit flaws in a 
network-enabled service to break into the 
lower levels of the software stack. From there, 
the malefactor can use utilities and other pro- 
grams present on the box to commit their ne- 
farious acts. In a unikernel stack, there are no 
other pieces of software to assist the malevo- 
lent hacker. The hacker has to be bright 
enough to penetrate the application, but then 
be brighter still to do evil things without any 
resident tools to leverage. It does not make 
the software completely secure, but it does 
raise the security bar significantly — and that's 
an advancement which is long overdue in the 
cloud. 


Ultra-lightweight: A normal VM could con- 
sume gigabytes of disk space and memory 
just to make a few services available to the 
network. With a unikernel, it's possible to gut 
those requirements. For example, MirageOS 
(a popular unikernel system) has a functional 
DNS server which uses 449 kilobytes of disk 
space — yes, less than half of a megabyte. 
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ClickOS, a network appliance unikernel sys- 
tem from NEC labs, has actual network de- 
vices that use just 6 megabytes of memory 
while successfully processing over 5 million 
packets per second. These are by no means 
atypical examples of unikernel-based devices. 
Given the diminutive footprint of unikernels, 
the notion of stacking hundreds or thousands 
of these tiny VMs on a single host server no 
longer seems far-fetched. 


Fast startup: Normal VMs can take serious 
time to boot up. It can take a minute or more 
on modern hardware for a full operating sys- 
tem and application stack to come online. 
However, this is not the case for a unikernel- 
based VM. Most unikernel VMs boot in less 
than a tenth of a second. For example, 
ClickOS network VMs have been documented 
to boot up in under 30 milliseconds. That's 
quick enough to birth a responding VM as 
soon as the service request appears on the 
network (which is one of the things which the 
Jitsu project does — see 
http://unikernel.org/files/2015-nsdi-jitsu.pdf). 


But Don't Containers Already Do This? 


Containers go a long way toward creating 
lightweight, fast VMs. But containers still rely 
on a shared beefy operating system under- 
neath the covers. That is still a lot to lock 
down from a security standpoint. And it is 
clear that we need to step up our security in 
the cloud, rather than pursue the same old se- 
curity methods which are rapidly becoming 
problematic in the cloud. Beyond that, the fi- 
nal footprint of unikernels is still smaller than 
what containers can provide. So containers 
move in the right direction, but unikernels man- 
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age to go farther in the direction which we 
need in tomorrow's cloud. 


So How Do Unikernels Work? 


As mentioned earlier, a traditional machine is 
built from the bottom up: you select a general- 
purpose kernel, add a slew of utilities, and 
then add the applications. Unikernels are the 
exact opposite: they are built top-down. Focus 
on the application you need to run and then 
add just enough operating system functions to 
make it come to life. 


Most unikernel systems rely on a compile- 
and-link system which takes the source code 
of the application and links in libraries which 
provide only those operating system functions 
that application requires, resulting in a single 
compiled image that can be run in a VM as-is 
without any additional software. 


How Do You Debug the Result? 


Since there is no operating system or utilities 
in the final product, most unikernel systems 
use a staged approach to 
development. Often, a compile while in the de- 
velopment phase will yield an executable suit- 
able for testing on Linux or other Unix-like op- 
erating system. This executable can be run 
and debugged like any standard program. 
Once you are satisfied with the result, you re- 
compile with the production switch turned on, 
creating the final image meant to be run 
standalone ina VM. 
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The lack of debugging tools on the production 
machine isn't as awkward as it may sound at 
first. The limitations on debugging a produc- 
tion image are mitigated by the fact that in 
most organizations, developers are not al- 
lowed to actually debug on a production ma- 
chine anyway. Instead, they gather up logs 
and other information, recreate a failure on a 
development platform, make corrections, and 
redeploy the result. That exact sequence is 
readily available in the unikernel world. You 
just need to make sure that your production 
image will produce enough logging output to 
facilitate forensic reconstruction of failures — 
and you may be doing that already in your 
standard application. 


What Unikernel Systems are available? 


There are a good selection of unikernel sys- 
tems already in place, supporting a large num- 
ber of languages, but the number of unikernel 
projects continues to grow. Some of the more 
popular unikernel systems include: 


° MirageOS: One of the oldest uniker- 
nels, it uses the Ocaml language. 


° HaLVM: Another early unikernel, it 
is built on Haskell. 


° LING: This long-established project 
employs Erlang. 


° ClickOS: Optimized for network ap- 
pliances, this has bindings for C, C++, and Py- 
thon. 


° OSv: A slightly different unikernel, it 
is based on Java with additional bindings 
which cover a large number of 
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languages. Most JAR files reportedly drop in 
and run. 


° Rumprun: Leveraging the modular 
code from the NetBSD project, it targets most 
any “POSIXy” application which doesn't need 
to fork. It is exceptionally well positioned for 
migrating existing applications into the uniker- 
nel world. 


Are Unikernels a Panacea? 


Unikernels are far from being a panacea. As 
they are single-process entities working in a 
single address space with no advanced mem- 
ory management, there are certain programs 
which will not easily lend themselves to exis- 
tence as a unikernel. However, a huge num- 
ber of services running in datacenters across 
the world will easily fit the bill. By converting 
these services into lightweight unikernels, we 
can reassign the server capacity we freed up 
to the heavier tasks which could benefit from 
additional resources. 


The number of tasks which lend themselves 
to being unikernels is larger than you might 
think. In 2015, Martin Lucina announced the 
successful creation of a “RAMP” stack. A vari- 
ant of the common “LAMP” stack (Linux. 
Apache, MySQL, PHP/Python), the “RAMP” 
stack employs NGINX, MySQL, and PHP 
each built on Rumprun. Rumprun is an in- 
stance of a Rump kernel, which is a unikernel 
system based on the modular operating sys- 
tem functions found in the NetBSD project. So 
even this very common solution stack can be 
successfully converted into unikernels. 
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For More Information 


To learn more about unikernels, check out http://www.unikernel.org/ or watch the talk | delivered 
at Southeast Linuxfest in 2015 at https://www.youtube.com/watch?v=8UgiPODw3CyY . 


About the Author: 


Russell has spent over two decades evangelizing Open 
Source, serving most recently as the evangelist for the Xen 
Project. Since his introduction to Linux in 1995, he has relent- 
lessly promoted the concept of Open Source to anyone who 
would listen. 


He has over 200 pieces published, including columns for In- 
foworld and Processor magazines, one book published, plus 
one on the way. He has spoken over 100 times at Open 
Source conferences, including the biggest Linux conferences in North America. A for- 
mer panelist on The Linux Show weekly webcast, he also has many years of experi- 
ence employing Open Source software in solutions for clients. 


He is currently looking for a new opportunity as an evangelist and/or community 
person for a FOSS project. 
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HOW IMPORTANT IS YOUR DATA? 


Years of family photos. Your entire music 
and movie collection. Office documents 
you've put hours of work into. Backups for 
every computer you own. We ask again, how 
important is your data? 


NOW IMAGINE LOSING IT ALL 


Losing one bit - that’s all it takes. One single bit, and 
your file is gone. 


The worst part? You won't know until you “ef : 
absolutely need that file again. Example of one-bit corruption 


THE SOLUTION 


The FreeNAS Mini has emerged as the clear choice to The Mini boasts these state-of-the- 
save your digital life. No other NAS in its class offers art features: 
ECC (error correcting code) memory and ZFS bitrot 


protection to ensure data always reaches disk * 8-core 2.4GHZ Intel® Atom™ processor 
P : . - Up to 16TB of storage capacity 
without corruption and never degrades over time. 


+ 16GB of ECC memory (with the option to upgrade 
to 32GB) 


No other NAS combines the inherent data integrity + 2x 1 Gigabit network controllers 
+ Remote management port (IPM) 


+ Tool-less design; hot swappable drive trays 
encryption. No other NAS provides comparable power - FreeNAS installed and configured 


and flexibility. The FreeNAS Mini is, hands-down, the 
best home and small office storage appliance you can 
buy on the market. When it comes to saving your 
important data, there simply is no other solution. 


and security of the ZFS filesystem with fast on-disk 


systems 


FREENAS 


CERTIFIED 
STORAGE 


With over six million downloads, 
FreeNAS is undisputedly the most 
popular storage operating system 
in the world. 


Sure, you could build your own FreeNAS system: 
research every hardware option, order all the 

parts, wait for everything to ship and arrive, vent at 
customer service because it hasnt, and finally build it 
yourself while hoping everything fits - only to install 
the software and discover that the system you spent 
days agonizing over isn’t even compatible. Or... 


MAKE IT EASY ON YOURSELF 


As the sponsors and lead developers of the FreeNAS 
project, iXsystems has combined over 20 years of 
hardware experience with our FreeNAS expertise to 
bring you FreeNAS Certified Storage. We make it 
easy to enjoy all the benefits of FreeNAS without 
the headache of building, setting up, configuring, 
and supporting it yourself. As one of the leaders in 
the storage industry, you know that you're getting the 
best combination of hardware designed for optimal 
performance with FreeNAS. 


Every FreeNAS server we ship is... 


» Custom built and optimized for your use case 

» Installed, configured, tested, and guaranteed to work out 
of the box 

» Supported by the Silicon Valley team that designed and 
built it 

» Backed by a 3 years parts and labor limited warranty 


http://www.iXsystems.com/storage/freenas-certified-storage/ 
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As one of the leaders in the storage industry, you 
know that you're getting the best combination 

of hardware designed for optimal performance 

with FreeNAS. Contact us today for a FREE Risk 
Elimination Consultation with one of our FreeNAS 
experts. Remember, every purchase directly supports 
the FreeNAS project so we can continue adding 
features and improvements to the software for years 
to come. And really - why would you buy a FreeNAS 
server from anyone else? 
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FreeNAS 1U 

+ Intel* Xeon* Processor E3-1200v2 Family 

+ Up to 16TB of storage capacity 

+ 16GB ECC memory (upgradable to 32GB) 

+ 2x 10/100/1000 Gigabit Ethernet controllers 
+ Redundant power supply 


FreeNAS 2U 
+ 2xIntel* Xeon* Processors E5-2600v2 Family 
+ Up to 48TB of storage capacity 
+ 32GB ECC memory (upgradable to 128GB) 
+ 4x 1GbE Network interface (Onboard) - 
(Upgradable to 2 x 10 Gigabit Interface} 
+ Redundant Power Supply 
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In this article, we will have an overview of what is called a sy- 
scall (system call shortened), from the kernel side to the us- 
erland, then in the end, how to create a new one in FreeBSD. 
It is assumed you know how to build FreeBSD currently and 


have some knowledge of C language. 


A syscall is a code implemented in the kernel side which can be potentially called from the user- 
land for various purposes; network, generating some random data, or controlling the system proc- 
esses. Whatever the type of syscall, the userland never interacts directly with the kernel, rather 
via a defined interface. Let us start with a simple example, the getpagesize call which is the num- 


ber of bytes per page. 


Let us see how it is implemented in the kernel. 
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Which simply returns the constant via the sysctl system. Let us see now how it is implemented in 
the userland's side: 


lib/libc/gen/getpagesize.c 


ate ele 

getpagesize (void) 

{ 
Acti ame alee 
Shortest avelues 
SUAS TG sulygee: 
LAL error? 
if (value != QO) 


return * (value)? 


/* Here we try to get the cached result as possible */ 


SEroul— eehh Aux Ln tO (Aye PAGE SA evo ltle asi zZecoOm (vale )a)r 
if (error == 0 && value != 0) 
return (value); 
/* Otherwise we get the result via the sysctl call */ 
mib[0] CTL HW; 
iq ob Bale HW PAGESIZE; 
size = sizeof value; 
iiotevserl (Moy 2p me a bene os UZe reel, 


Ie Sucbgia Eek 


As you can see in this case, the work is mainly done in the userland side. It performs another 
type of syscall, where all the implementation is done in the kernel side only but its symbol is trans- 
mitted via a symbol map. Next, let’s have a look at the getpid syscall. The usual C function has 
this signature: 


Those syscalls are organized per type in the kernel, and implemented in the files 
src/sys/kern/(kern/sys)_ *.c. Basically, the sys_* files hold the function implementations, but if the 
complexity requires it, some codes are split in the kern_* ones. 


First of all, the struct getpid_args reflects the userland parameters, every syscall needs a corre- 
sponding “args struct to pass the userland parameters, hence as getpid has none, here we have 
a dummy's. 


This type of syscall has this signature: 


The thread parameter is the current thread from which we can get the current process, locking it, 
in order to modify or just read a specific state...the integer return serves here to, potentially, set 


errno in errors code paths. BS 
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Here is the corresponding getpid implementation. In the case of getpid, it is always successful, 
errno is never set so we return 0 directly. 


SrC/Ssys/kern/sys. prot .c 


a aN 


Sy eect pia (Strict ernready ta seri cEenceceptdgargs “ua! 


{ 


SABIeDICl oneieves Myjor Naseer aseh jonqderey 


[6 Greases ie igeull (0) ire Ong Oatiole 
fi. oer ued (COMPA Tea) 

16 ee 1eh a euonigeoulial| ih Issn (efsieiojeavel ee) 
#fendif 


ia@svebaciae (0k) < 


atvainz 

[Senetgl Wefeisje enbol(Gasiabieie. Uelguacreicl  aeel)) 

{ 
SIGE ICE OIgOlos “eek TF MeO eae ongeien 
SELUCw epLoc spp: 


ihahagysiennel 
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PROG? EOCK (po); 
ane Gloire eerie lercloy are cle edb: WOlcnIDy RN) 
Dette ais > eee old, 
PROC SUNTOCK (o)r, 
} else { 
PROC UNLOCK (p) ; 
Bees HOCK proce rect och) 
PD = Croc rea lparene (ip); 
[ISHN =" 4S )elee ae eubiele, 
Sx oUnNPOCK (Gp rocer ee lock), 
} 


i@elohiaiak «Colonie ee 


/* Returns the real parent process whether it had exited or 
traverses the orphaned linked list */ 


Se hee Or OC. 


PEOcs bea loareum(Serueey OLocs. cliid) 


{ 
SebuUCh DOG e Dy 1 Oo kelias, 
SX Lassere (Gproct tee tock, ox eLOCKED) 
shee O1(% (elaine lab 0p Seneele ne lgevep™ ce OANA ie (OI Aa VAIN eR) Pa 0b)" ah 


if (child->p oppid == | | 
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(elguilie lj) icneae = jens oatel “—— ye) mal Ich o8 Tejejoayel)| 


parent GlomlKe ie 404 |e) oieray 


parent EMial Mi elonaele 7 


return (parent); 


(p = child; (p->p_treeflag & P TREE FIRST ORPHAN) == 0;) 
(Cannot use LIST PREV (), since theslist lead is enot 


Pre Conca tet OmM p> pO lounal enpre ys SErUCE proc, 
Plerpnan. le next); 
KASSERT ((p->p_treeflag & P TREE ORPHANED) != 0, 
(Arle isi gte 1s) AONUa IRIN “a1! a sje) 
} 
Pesenr bse COM care VO (a= peer ial | evpre  eoe aera aoe, 
Prompinawic Uhr ies tr, 


return (parent) ; 


Now, the next step to see is how the kernel makes sys_getpid available to the userland. 


Our getpid syscall can be found in sys/kern/syscalls.master file: 


Z0 (NON, TEN awe AOD SUB: Veber Cece Lavo ud) i 7; 


20 is the syscall identifier, AUE_GETPID is the auditing event. Auditing in FreeBSD is the possibil- 
ity to log different types of information from those syscalls: authentication, file descriptor opera- 
tions (via fcntl call), userid/groupid changes, etc. In our case, in fact, AUE_GETPID is equal to 
AUE_NULL, which means no auditing. STD means it is a standard syscall. 


Syscall was introduced in 4.0 BSD (circa 1980) and its signature is as follows: 


When it was introduced, there was no issue; due to having 32 and 64 bits types, it is not possible 
to use syscall function but = syscall: 


Although it is practical to test a system call not available in the userland side, it is somehow not 
possible to have a function which returns values as arrays. 


FreeBSD allows adding new syscalls similar to the ones above. For example, let us make a sy- 
scall which returns the full command of a given pid (and if the pid is -1 then it would be the cur- 
rent one) which would have this signature: 


It might be advised to create a new file instead of updating sys _generic.c, let us create 
sys_custom.c inside sys/kern folder: 


WV 
UO 
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It might be advised to create a new file instead of updating sys_generic.c, let us create 
sys_custom.c inside sys/kern folder: 


#include <sys/cdefs.h> 


__FBSDID("$FreeBSDS") ; 


#include <sys/param.h> 
#include <sys/systm.h> 
fincludes<sys/ lock, a> 
#include <sys/sx.h> 

#include <sys/mutex.h> 
#include <sys/proc.h> 
#include <sys/errno.h> 


Finelude vsys/syscul. b> 


#include <sys/sysproto.h> 


// Here this is just for the example, having a “optin” to enable our custom function: 


Slate wine vena bile Tels ton 
pipe Pia iNiiecebucg,. OLD AUTO, enable Vveusrom, CL br EAG RW, 


sonable cuspon Us nelle Reus tom); 


seks 
SVS) CUSTOM TUNG (Stree Mrliread td, struct Cuscomyrlune args-"“Uuap) 


{ 
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ele = nero aleve Wesel 0) 


memset (uap->buf, 0, uap->buflen); 


vag, eave’ oulee Soubishecol e200) | 
// We set errno f the buffer is too small or 
if (uap->buflen < MAXCOMLEN) { 
(Oe wel arcus igeiha (0) =U 
error = EINVAL; 
ele ele eye 
} 
)/ iti WET dOVnOE hind wour speci c process 
shjee (abbey eie ejonkieh Ss wks Yt 
pfind(uap->pid)) == NULL) { 
td] ba geer vay =a 
error = ESRCH; 
SOeewoue, 


} 


PROC LUNEOCK (a); 


Wick aAmek Jens ey 


// Before copying to the buffer the command, we lock the process 


PROC LOCK (p); 


SELlCOYy (a= DUE wo pr cons MA CCOMmnnIN je 
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To declare our new function, we need to add this in sys/kern/syscalls.master file: 


Note the identifier must be unique, we just increment from the previous. Then in our FreeBSD 
source folder, we could type this: 


Now there are new entries in sys/sys/sysproto.h header, first we have our userland struct arg: 
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And our kernel function declared: 


saehe Sys cus Lom, GUNG Se LUCt PENT Cad ta, Se EUCERCUSlOMs HUGH cms ae), 


We need to declare our new file sys_custom.c to the sys/conf/files file as below: 


Kern sye. CUStom.C standard 


So the next time we compile the kernel it will be taken into account. Last, we need to make this 
function available, exporting its symbols: 


ito Lee) sys 5 ymoclemap 


custom: tune; 


EBoDprivate st. 044 


ScuUstom func, 


Sysr cust OMeOUnG, 
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Once we have updated our system, our new function and our new sysctl ought to be available. 
We could test this new function with this short sample code: 


dee stisieian Iga, Ssuscler: Geinsuo: *euvsluale iia) <4) 


Char buf [MAXCOMMLEN] ; 
(OnGh E eseu ee eleimenlncl |), 
alam ACEAbESS C0} (i) amie gredeubicla lelblay: 


Primer ( command On ~ord = dis 


SVisCeladebuG seraoVereus -om 
0 
My Ecole 
—OPrOouUroulE = 


SyscllLradebug enable, cisvomn=| 


Sie Ole 
COlManid OL pic vi a2 esi aS Oln. 


PBoUpirivabem!. 04 


PeUstom eunc, 


SVS (CUuStOMm mune; 
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To have an idea which calls are used during our tests, we can use the famous ktrace: 


Apparently our syscalls went well, the return value is 0 with a valid pid, but with an invalid: 


If you think a new syscall is needed, then you can either discuss it in the dev freebsd mailing list 
or propose a patch maintaining it locally; this kind of code change might bring difficulty when up- 
dating the source with new official syscalls added and conflicting identifiers. At least hopefully, 
this article gave you the desire to dig into this topic. 
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FreeBSD Kernel Module 1 


by David Carlier 


In this module, we will give an overview of the nature of the 
FreeBSD’s kernel. The important configuration files will be 
explained in addition to learning how to compile the whole 
system with more options, with more debugging informa- 
tion. Very useful for kernel development. 


Requirements: 
° FreeBSD 10.x. 
° Machine with at least 4 cores is recommended for the system compilation. 
° Genuine hardware or virtualized environment as your convenience. 

The FreeBSD kernel. 


FreeBSD, like many kernels, is a monolithic kernel with loadable module support. Hence, it is pos- 
sible to build FreeBSD’s kernel with all needed modules statically or those ones that support it, as 
separated dynamic loadable modules. 


The latter ones can be loaded and unloaded at will at boot time: 


(sneme or kernel ymedule -plead= YEo Sine Dec loader, cont rile) 


or via 


kitdicad/ kildinicad- 
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To have an overview of all currently loaded modules, you can type klidstat. For example, the out- 


put looks like the following: 


Let’s load the DTrace module by typing kldload dtraceall. Then if we type kldstat again, we 
should see some new entries related to this module: 


If we add dtraceall load=“YES”, we will be able to use Dtrace framework facility. You can 
find an excellent introduction of dtrace in the BSDmag issue of last December. Indeed, Dtrace 
can be very useful for tracing syscalls. 


In order to build the system, we need the whole source code, hence the kernel and the userland. 
The userland is simply all the base utilities of FreeBSD. Both kernel and userland code are consis- 
tent and tied together, available in the same subversion repository. Apart from pure BSD codes, 
we can find GNU libraries and software (called contrib code). In addition, for ZFS, CTF (Compact 
C Type Format debug section, similar to DWARF format but reduced in term of size) and DTrace 
proper compilations, some CDDL codes are present. Happily, FreeBSD is provided with subver- 
sion in base, suffixed distinctly to avoid colliding with the port version: 


¢ checkout the source in /usr/src via svnlite 


¢ svnlite co https://svn0O.us-east.freebsd.org/base/stable/10 /usr /src (or you can check 
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out the current branch with much newer code but with more instability, you can just replace 
stable/10 by head). 

To better understand how the kernel options work, let’s have a look at /usr/src/sys/conf/ 
options file: 


SFreeBSDS$ 
On the handling of kernel options 


All kernel options should be listed in NOTES, with suitable 
descriptions. Negative options (options that make some code not 


compile) should be commented out; LINT (generated from NOTES) 
should 


# Compile as much code as possible. Try ilo Struclure: oprion-using 
Coder Sso.tiat tags ingle roprlonmnonly  switenrecode, Gn, Of sony  swit en 
Code, orf, tovmmeke vir possible to Nave 2 etull=comprle-Lrest elt 
ReECesse ey eyOUmcany Check tT OmeCOMZ RING OLN ie roecger) mara mum, «code 


COV CEAeiSr: 


All new options shall also be listed in either "conf/options" or 


this 1s a kernel-wide option (used just about everywhere), or in 


ODE) COe1OU-Naile-Iihower-cace = ati ele abheecre Oily some. 1 les. 


Note that the effect of listing only an option without a 
header-file—name vin. conf, options | (and cousins)eis that, the last 


CCnvenit Lon, use hollowed, 
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This handling scheme is not yet fully implemented. 


PorMmat. Of «thats. tie: 


Option name filename 


If filename is missing, the default is 
COE Name -Cf Option ti a lowerseace li 


AAC DEBUG TOO waaG,,.1 


PP Che (DEBUG sop re ecdeac falc. im 


AHC ALLOW MEMIO opt _aic7xxx.h 

AHC _TMODE ENABLE opt _aic7xxx.h 
AHC_ DUMP EEPROM opt aic7xxx.h 
ACV DEBUG opts ales xxxsh 

DiC DEBUCZORES Opt rete) xxx oh 

AHC REG PRETTY PRINT opt aic7xxx.h 
AnD SOE BUG Op r ae (xx. it 
ADE DE BUEHOPTS tOpbeake] Oxx. i 

AHD TMODE ENABLE opt _aic79xx.h 

AHD REG PRETTY PRINT opt aic79xx.h 


ADW ALLOW MEMIO opt _adw.h 
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For each line, the option’s name then the file created with the relevant preprocessor defined. If 
the option is present in your kernel configuration file, let's say AHD DEBUG OPTS, it is possible to 
test if AHD_DEBUG OPTS is defined and providing some contextual code for this option. Let’s 
imagine we did a new shiny kernel module, we could add our proper line in this file. 


Another important file is /usr/src/sys/conf/file. 
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Call/ CL U/cLl wbackends vamdisk. efopEelronal cr 


cam, Gel er ilvend ttalleteropelonelecrl 


ps 


Gam/crl/ cel frontend. cyoptlonalycr| 


a Os 


cam Gril erst sontend cams ml eropulonal eri 


-. 


Call (Cel) Cube ironcendminecuna bh epoperon] luctrL 


cam, Cel, Celirrontend asesit, eso pel one ln cell 
Caml erly Culyseo taal eHopeionalactuL 

Cam ClEy CL iar pe. Chopulonal eer! 

Gam Cel) CeLVepecelocal chop elLougmerc el 


Gam Gel cilierror.c VOp trond ly cpl 


@eyy Mele lLy enadk Soneih lave ne) oe Worguerlk. Touma 


_ 


Gall Cel scsi, C7ope ronal pert 


@elily Sersak, Sse Ceige C)sieaelateil cell 


Srslity iets lg ree sh, Ane “ejeneakiouarctlk, teie. |) talesye |) jaysier |) wsvece 
Callies l/ Sesivoacs Cyopti onal yoacs 
Call SCs sect tpl ¢. Opt onal spr 


Gam, SCs SCs sa .¢ opelenalisa 


For each line the relative path to sys, the type of module, if optional it will be compiled with the 
(lower case) option name written afterwards. Again, with our new module, we can add in our spe- 
cific kernel module C file, let's say workshop modulel.c. 


workshop bsdmagmodulel.c optional bsdmag 
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So now we can create a custom kernel config. Let’s call it WORKSHOP. 


Steps to build a system: 


First, the userland needs to be compiled. 


If your machine has multiple cores, it is advised to use them for the system compilation. It might 
take several hours depending on your current configuration. 


You could possibly do (i.e., create and install the kernel at once): 


Restart in single user: 


Eventually: 


Then make: 
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And: 


mergemaster -FU1 


Mergemaster will try to merge various configurations files, asking you how you wish to proceed, 
merging as possible, replacing with a newer one or keeping the existing. Restart in normal mode. 


You should have now a workable system with the latest fixes/patches for the 10.x branch. But, as 
a developer, we might need more info from the system for debugging, studying the core dump af- 
ter a system crash/kernel panic. It is advised, as kernel developer, to enable kernel core dump 
writing (could be enabled when you installed FreeBSD or, afterwards, can be enabled via dump- 
dir rc.conf variable) at the cost of disk space consuming (can be potentially important, deleting 
old ones is necessary). They are, by default, located in /var/crash. In order to debug a kernel 
crash dump, the kernel compiled with debugging symbols, kernel.debug, is necessary. gdb can 
already be used this way. 


kgdb 

GNU gdb 6.1.1 [FreeBSD] 

Copyright 2004 Free Software Foundation, Inc. 

GDB is free software, covered by the GNU General Public License, and you are 
welcome to change it and/or distribute copies of it under certain conditions. 
Type "show copying" to see the conditions. 

There is absolutely no warranty for GDB. Type "show warranty" for details. 
This GDB was configured as "amd64-marcel-freebsd"... 

Reading symbols from /boot/kernel/ng_ubt.ko.symbols...done. 

Loaded symbols for /boot/kernel/ng_ubt.ko.symbols 

Reading symbols from /boot/kernel/netgraph.ko.symbols...done. 

Loaded symbols for /boot/kernel/netgraph.ko.symbols 

Reading symbols from /boot/kernel/ng_hci.ko.symbols...done. 

Loaded symbols for /boot/kernel/ng_hci.ko.symbols 


Reading symbols from /boot/kernel/ng_bluetooth.ko.symbols...done. 
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Loaded symbols for /boot/kernel/ng_bluetooth.ko.symbols 


Reading symbols from /boot/kernel/ng_|l2cap.ko.symbols...done. 
Loaded symbols for /boot/kernel/ng_l2cap.ko.symbols 

Reading symbols from /boot/kernel/ng_btsocket.ko.symbols...done. 
Loaded symbols for /boot/kernel/ng_btsocket.ko.symbols 
Reading symbols from /boot/kernel/ng_socket.ko.symbols...done. 
Loaded symbols for /boot/kernel/ng_socket.ko.symbols 

Reading symbols from /boot/kernel/dtraceall.ko.symbols...done. 
Loaded symbols for /boot/kernel/dtraceall.ko.symbols 

Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. 
Loaded symbols for /boot/kernel/opensolaris.ko.symbols 
Reading symbols from /boot/kernel/dtrace.ko.symbols...done. 
Loaded symbols for /boot/kernel/dtrace.ko.symbols 

Reading symbols from /boot/kernel/dtmalloc.ko.symbols...done. 
Loaded symbols for /boot/kernel/dtmalloc.ko.symbols 

Reading symbols from /boot/kernel/dtnfscl.ko.symbols...done. 
Loaded symbols for /boot/kernel/dtnfscl.ko.symbols 

Reading symbols from /boot/kernel/fbt.ko.symbols...done. 
Loaded symbols for /boot/kernel/fbt.ko.symbols 

Reading symbols from /boot/kernel/fasttrap.ko.symbols...done. 
Loaded symbols for /boot/kernel/fasttrap.ko.symbols 

Reading symbols from /boot/kernel/lockstat.ko.symbols...done. 
Loaded symbols for /boot/kernelNockstat.ko.symbols 

Reading symbols from /boot/kernel/sdt.ko.symbols...done. 


Loaded symbols for /boot/kernel/sdt.ko.symbols 
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Reading symbols from /boot/kernel/systrace.ko.symbols...done. 

Loaded symbols for /boot/kernel/systrace.ko.symbols 

Reading symbols from /boot/kernel/systrace_freebsd32.ko.symbols...done. 
Loaded symbols for /boot/kernel/systrace_freebsd32.ko.symbols 

Reading symbols from /boot/kernel/profile.ko.symbols...done. 


Loaded symbols for /boot/kernel/profile.ko.symbols 
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{OeUxXCPEPe eu noUIOT Selig dskqucle eines hoop a (aro —— Ue wOpe Mel Zed 
CUES) at /Usr/sre/sys/kern/subr taskqueue.c:118 


PorUxtit terre O0le 7st bork ex tem(cCallouc—OxrEiLi irr cugotODU 
“las kquever iecad Nooo wala mprr hn oUUN Sebe Oye tira 
Me“OcMEEE ibe) s7e Ur ac) Melb, Wom) sise/ SyVc7 Keun Keune Omlq e716 


( MOxXEi Pi ieir eeOdA tA Peeinwiorieecompols fem (jm ac 
/usr/src/sys/amd64/amd64/exception.S:610 


7o Ux0000000000000C00F in 224 () 

Also list if we want to see 

(ko db) Mitcre (<n ibreriprs0o5aa47 

UEP Phi hh UO s2et eis Mee Sleep Ust/ sic) sys, kenny) etme syNCi ne. 254), 
249 else if (sbt != QO) 

Zo Sieve te keeog a eimedwal e(tcdent, sp a1))s; 
25 lvelse 1f- (catch) 

CASA ev eeldh SrCSPGeWalUmolG (cents obi): 
293 else { 

aoe Leepagiwale (tdene, sy Pri) 

paayon aan elk, f= AO) 

TON = 

257 #ifdef KTRACE 


ZIogee (I ReORNE (cd pak Pha Gol))) 


Then, for example, going up in the stack frames calls and so on: 


(kgdb) sp) 2 
fo OxXEPEEPErere0ISado7 yin sleep (idene—0x0)) Lock-Uxtriracog03scoa30, 


DELOKIty=0,0 wmesq—-OxXPEPErPErEeOrr4/i2. =" sbt=0,7 .pr—0, 
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For more information about gdb, a good helpful workshop exists about this topic: 


Indeed, especially if you run the -CURRENT branch, the kernel can crash for various reasons and 
this gdb like tool is handy to have a basic understanding of the reasons. 


Indeed, FreeBSD does not rely on the Giant Lock model anymore, it is based on fine grained 
level process locking/unlocking. Hence the resulting programming can be tricky and it is easy to 
get lock contentions. 


With this workshop module, you learned the basics of kernel custom configuration, compiling the 
whole system. 
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Exercise: 


. In order to enable those additional capabilities, deadlock detections, more debugging 
info, additional checking ... Which options in conf/options are needed? 


° Recompile the kernel with those options. 


. Once the system is restarted, which differences are you noticing? What are eventually 
the downsides? 


° Is it possible to improve the situation? How? 


About the Author: 
David Carlier is a developer since 2001, mainly C/ 
C++, living and working in Ireland mainly since 


2012. He contributes to some open source pro- 
jects and uses in a daily basis various op- erating 


te systems mainly BSD flavours. 


From Editor: 


|. This is a first module of Developing FreeBSD Kernel Modules Online Course that 
used to be available on our web page. With Instructor we decided to take it down, 
because of incompleteness of course materials. 


If you liked materials from this course, feel free to check our other online courses, 
which you can still join: 


¢ Application Debugging and troubleshooting 


https://osdmag.org/course/application-debugging-and-troubleshooting-2/ 


§ ° Deploying on office / workgroup server on FreeBSD 


https://osdmag.org/course/deploying-on-office-workgroup-servers-on-freebsd-2/ 


¢ Practical Python Workshop 


https://osdmag.org/course/python-programming-coming-next/ 
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How to Upgrade OpenBSD and 
Build a Kernel 


by Bob Cromwell 


Let's see how to upgrade your OpenBSD system. Maybe 
you are doing this because the latest release just came out. 
If so, this is pretty simple: back up your data, boot from in- 
stall media, and select "Upgrade" instead of "Install". But 
maybe the latest release has been out for a few months. 
Why would we go through the trouble of building and install- 
ing a new kernel or other core system components? Maybe 
some patches have been released to improve system secu- 
rity or stability. It is pretty easy to build and install a kernel 
on OpenBSD, easier and simpler in many ways than it is on 
Linux. 


Verify that You Have the Real Operating System 


If you purchase OpenBSD media then you have the real operating system. But what if you down- 
load it? 


From the 5.5 release forward, you have the signify command along with the needed public keys 
in the /etc/signify directory. The OpenBSD project generates the key pair for the next re- 
lease ahead of time, so you already have the public key for the next release. Once you have a 
trusted /etc/signify key collection, upgrade to every release and you can always verify 


things as you go. 
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This is better than the Linux kernel signing model! At the Linux kernel archive there is a digital sig- 
nature file accompanying every kernel source code archive or patch file, but there is no clear 
mechanism for getting a trustworthy copy of the kernel organization's public key. The kernel.org 
site has some hand-waving about using a web of trust for PGP keys, then they tell you to track 
down a kernel developer in person and sign each others' keys. That's accompanied by a link to a 
Google map which absurdly tags a spot in the middle of the Atlantic Ocean as Cambridge, Massa- 
chusetts, one of the outer Aleutian Islands as Austin, Texas, and a spot in the White Sea off the 
Kola Peninsula as Oldenburg, Denmark. The most help | can provide you regarding the validity of 
the PGP signing key for the Linux kernel is that I'm convinced that it's key ID 0x6092693E with a 
fingerprint of: 


I'm convinced because that key has been used to sign the kernel source code for a number of 
years with no announcement of the site being hacked or the signing key being bogus. 


But the good news with OpenBSD is that we have the security tools and keys in place. So, let's 
use them! Make sure you also download the file SHA256.sig accompanying the installation ar- 
chives or source code archives. 


If you are preparing to patch a kernel or other parts of the core system (applications, shared librar- 
ies, etc), or if you want to build or update any of the ports, go to the appropriate release directory 
/pub/OpenBSD/X.Y and download files sys.tar.gz (the kernel), src.tar.gz (the rest of 
the core system), ports.tar.gz (ports), and also SHA256.sig, the digitally signed list of SHA- 
2-256 hashes of those archives. 


If you are preparing an upgrade to a new release, go to the appropriate architecture-specific direc- 
tory /pub/OpenBSD/X.Y/arch and download the appropriate bootable image cdXY.iso or 
installXY.iso, and also SHA256.sig, the digitally signed list of SHA-2-256 hashes of those image 
files. The file from the release directory /pub/OpenBSD/x. Y looks like this: 
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Now we can verify that we got the real software from the real OpenBSD project: 


The way that this works is that the second line of the SHA256.sig file is a signature for the file 
itself. If there has been any change (or addition or deletion) to the file, signify exits with the mes- 
sage "signature verification failed." 
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If the SHA256.sig file is good, you see "Signature Verified" and then one line for each of the 
listed files with its name and then "OK" or "FAIL". Here's the result of downloading just three ar- 
chive files and using both a good signature file and one in which | changed one character of the 
hash for a file that | hadn't even downloaded: 
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Do not proceed until you see "OK" reported for each downloaded file. Of course, if you only 
downloaded some of the files listed in the SHA256.sig file, you will see "FAIL" for the missing files 
as in my example. That's fine. 


Make sure your data is safely backed up before proceeding. 


If you are starting a graphical display manager 
through /etc/rc.local or another mechanism, 
disable that temporarily. 


How to : Burn the appropriate OpenBSD installation media if 
: =< ~ | : ‘| you are upgrading to a new release. Boot from that 
| Ree media and select U for "Upgrade", and let it down- 


load and install the base operating system. 


If you aren't building a new kernel, skip ahead to the 
steps needed to upgrade the packages. But if you 
are going to build a patched kernel... 


Figure 1. Upgrading OpenBSD Kernel. 


All the building and rebuilding on OpenBSD goes on under the /usr/src/ directory. It is empty 
when you first install the system. The source for the kernel and the userspace tools go into subdi- 
rectories. 


Let's say that you downloaded the source code archives to /tmp. Install them: 
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Now you need to apply all the patches. They exist for good reasons — to fix problems of stability 
or security. Apply those patches! 


The current patch list will be found at a URL resembling hito://www.openbs g/errataXY.html 
change XY to reflect your release minus the decimal point. Download the archive of all those 
patches, let's assume you also saved it to /tmp/X.Y.tar.gz. Extract the archive and become 
root: 


View each patch file to see its explanation of how to use signify and patch. Just copy and paste 


that two-line command into place. It will be something like this: 


If the patch is for an application, the patch file comment block will tell you what to do next. Follow- 
ing that is the actual patch content. For example, building and installing the patched code will 
likely require something like this: 


BSD 


MAGAZINE 


58 


But if the patch is for the kernel, the patch file will just say "Then build and install a new kernel." 
Keep reading to see how! 


Change to the appropriate directory, changing in the following commands as needed to re- 
flect your hardware. OpenBSD runs on a lot of platforms, your choices include: 


The file GENERIC contains the kernel configuration. It's just a little over 600 lines long, versus the 
7,700 or more lines in a recent Linux kernel configuration file. 


There are options near the top for support of GPT (GUID Partition Tables, needed for disks larger 
than 2 TB) and Microsoft's NTFS file system. Simply comment out a line with "#" to disable that 
option or leave a driver out of the kernel. As an example, | once had to disable (or omit) the apm 
driver when | was running old OpenBSD on even older hardware. 


If you want to change the kernel message colors from the generic white text on a blue back- 
ground, then first add two lines to: 


| don't care for the default white-on-blue. It looks too much like a Windows crash screen. You can 
specify the foreground text color (FG) and background color (BG) of console kernel messages: 
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You don't have many choices. According to: 


/usr/src/sys/dev/wscons/wsdisplayvar.h 


the only colors are black, red, green, blue, brown (really a dark yellow), magenta, cyan, and 
white. For what it's worth, white on green is kind of hard to read. Black on brown is as close to 
Purdue gold and black as it gets. 


Multibooting OpenBSD & Windows 


If you are multibooting with Windows, realize that OpenBSD assumes that the hardware clock is 
set to UTC while Windows assumes it is set to the local time. You can set the hardware clock to 
local time and then specify the OpenBSD kernel's offset in minutes. | live in the US-EST time 
zone, 5 hours or 300 minutes behind UTC, so | could set the hardware clock to US-EST and then 
do this: 


option WS KERNEL FG=WSCOL BLACK 


option WS KERNEL BG=WSCOL GREEN 


option TIMEZONE=300 


Virtualization commands: 


However, | don't boot my laptop into Windows very often at all, especially now that | have a Win- 
dows virtual machine running under QEMU/KVM on my main Linux desktop. | just set the hard- 
ware to UTC, leave out the TIMEZONE option, and tell Windows that it's in UTC. 
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Configure the build with your CONF TG file: 


Prepare to build, removing any leftover object files and setting up dependencies: 


Build the kernel: 
That will take a few minutes, and should eventually result in a binary named bsd. On my system 


with an Intel Celeron 900 running at 2.2 GHz, it takes almost six minutes. 


This just takes one command, and watch what it does: 
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If the new kernel file is different from the currently installed one, some files are shuffled around so 
that /bsd is the new kernel and /obsd is the previous one. That way, if some inappropriate 
changes in your kernel configuration file led to a dysfunctional kernel, you can reset the system 
and ask for the old one. 


That should just simply work! 


If it didn't, remember that you can ask for the old backup kernel at the boot prompt. And you don't 
have to remember its name, you can ask with the Is command to the boot prompt. And you don't 
even have to remember that, h gets you a list of the available boot prompt commands: 
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OpenBSD 


machine: boot comaddr diskinfo memory 

lelelenuee dlrs 
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stat (hd0a:/./sys): No such file or directory 
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Running OpenBSD on old laptops 


If you have the APM issue that required a kernel configuration change to install and boot in the 
first place, then see my page about installing OpenBSD on a Dell laptop to refresh your memory 
as to how to accomplish this. 


The alternative would have been to modify the kernel configuration by editing the file: 


/usr/src/sys/arch/amd64/conf/GENERIC 


before building a kernel that leaves out that driver. 


However, if you are really qualified to modify the kernel configuration before building and install- 
ing it, I'm not sure why you're reading this page! 


| got lost! 
Take me back to the kernel build! 
Upgrading Packages 


You will need to upgrade all the added packages. It is very easy to upgrade the packages you in- 
stalled from the OpenBSD distribution: 


# pkg add -u 


The core of the operating system, what you get with an installation, has been checked very care- 
fully. The much larger collection of packages, basically those components that will be installed un- 
der the /usr/local hierarchy, haven't been checked as carefully. However, at least some de- 
sign and implementation auditing is done and the packages are digitally signed. Things like the 
KDE Desktop Environment will be buggier than the plain X desktop provided in the core release, 
but at least you're getting just naturally occurring bugs and not Trojan Horses. 


The pkg add program checks digital signatures and will only install those with a good signa- 
ture. You can see what's going on by downloading and extracting the gzip-compressed tar file for 
a package. You will get the collection of files making up the package plus +CONTENTS, +DESC, 
and possibly others named +*. The +CONTENTS file contains something like the following from 
the aescrypt package, which has the security parts highlighted: 
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@comment SOpenBSD: PLIST,v 1.2 2004/09/15 18:35:59 espie Exp $ 
@name aescrypt-0.7p0 
@signer openbsd-58-pkg 


@digital-signature 
siqnify:2015—-08-097T11+42:524: RWRI KI ZarPaVL/ Yanu9YhbPdOyWgsb /ShvakOi¢€gB 
rowWRyWrqYkzxocPvyzgIvViAKAbDN201D/alUYW6a4vfcgSAHCBGeu8tOYQo= 


@comment pkgpath=security/aescrypt cdrom=yes ftp=yes 
@arch amd64 

aD) cet Oe 

@sha Sise4CvlTcCZ3v0a04uR2 6nPXM31X1IzXi80Z2M1XeuA= 
@size 416 

Chigetenedestle mers cn O laa 

@cwd /usr/local 

bin/aescrypt 

@sha fnHWBdfHf 7WLMR33Mk9134xQ/3yqyoxX4j/ixJ4ZNEr5c= 
@size 36608 


@ts 1438963247 


bin/aesget 


@sha XARARn2gi0R6udvoxJT6Sx/O5Us4Nx/el/Zfv80p6ws= 
@size 36608 

@ts 1438963247 

share/doc/aescrypt/ 
share/doc/aescrypt/README.html 


@sha CKtEtiNFdKjbZSi3xyaXoT2Btz2yP1FbDmkTkhApDf 8= 


The @digital-signature line contains a digital signature for the +CONTENTS file itself. That 
digital signature must be valid in order to continue. Now we can trust the @sha lines to tell us the 
Base64-encoded SHA-2-256 hashes of the components +DESC, bin/aescrypt, bin/ 
aesget, and share/doc/aescrypt/README.html. This is pretty well hidden from the admin- 
istrator, you only see hints of what's going on when you pass -vvv to pkg_add to tell it to be 
triply verbose! Let's verify what's happened once the package is installed: 
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Notice that the measured SHA-2-256 hashes agree with what was specified in the +CONTENTS 
file — the pkg add program wouldn't have installed the package if they hadn't matched 
those in that digitally-signed list! 


If you use the KDE display manager kdm, then you may have fixed it to start an SSH agent at 
login as described here. You will need to do that again if you want to continue using that method. 
However, maintenance is easier if you use Keychain instead. 


If you are using LaTeX and/or TeTeX in a region of the world with a mutant paper size (like the 
U.S. and Canada), then you need to run texconfig as root and specify your paper size. 


If you are using Wireshark or the command-line tshark, remember to change the devices 
/dev/bp£f* to be readable by a group containing those users who should be able to capture 
packets in that group. The details are here. 


The above recommendation on downloading, installing, and patching the application source code 
will have some of the work out of the way. At least you will have patched and trusted source code. 


What remains is to build and install the binaries based on the patched code. See the patch files 
for the details, but this generally requires something like the following, where you would skip the 
patch application if you have already done it: 


If this fails with an error message message about "don't know how to make ...", then you need to 
clean things up before doing the build. Do the following and then restart building that binary. No- 
tice that the pushd and popd leave you wherever you were before applying this fix: 
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Rebuilding Other Open-Source Packages 


If you built and installed any open-source packages under the old version, you will need to re- 
build them to match the current set of shared libraries (and this may involve rebuilding some 
shared libraries you built and installed). See my pages on building Wireshark, OpenCV, Open- 
VAS, and RainbowCrack on OpenBSD. 


How to Compile Software on OpenBSD: 
Wireshark OpenCV OpenVAS Rainbow Crack 


How to build Linux kernels How to install and run OpenBSD on a low-end Dell laptop Various 
Linux / UNIX topics 


About the Author: 


I've been using OpenBSD since, well, not sure how long... 
Some time in the late 1990s. I've used Linux since you 
downloaded 40+ floppy images, some time around | 
1993-1994. Before that | had used UNIX, SunOS and 
forms of BSD, at Purdue since the mid 1980s. | gota 
BSEE at Purdue back then, worked at the university, grad 
school, Ph.D. in electrical and computer engineering, have 
done consulting since 1992. I've taught courses for Learn- 
ing Tree International since the mid 1900s, and have writ- | 
ten courses for them since the late 1990s. 
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Maxing Out Storage Performance 
with ZFS Caching 


by Mark VonFange 


One of the more beneficial features of the ZFS filesystem is 

the way it allows for tiered caching of data through the use 

of memory, read and write caches. By optimizing memory in 

conjunction with high speed SSD drives, significant perform- 
ance gains can be achieved for your storage. 


The first level of caching in ZFS is the Adap- 
tive Replacement Cache (ARC), which is com- 
posed of your system’s DRAM. It is the first 
destination for all data written to a ZFS pool, 
and it is the fastest (i.e. lowest-latency) source 
for data read from a ZFS pool. When data is 
requested from ZFS, it looks first to the ARC; if 
it is there, it can be retrieved extremely quickly 
(typically in nanoseconds) and provided back 
to the application.This provides greater read 
performance improvements - by orders of mag- 
nitude - over older methodologies like short- 
stroked spinning disks, which are power hun- 
gry and expensive. 


The contents of the ARC are balanced be- 
tween the most recently used (MRU) and most 
frequently used (MFU) data. This balance is 
important. Normally, running a backup prod- 
uct would walk the entire file system and effec- 
tively invalidate the cache. Since ZFS utilizes 
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algorithms to track frequently used data in ad- 
dition to recently used data, your cache de- 
vices will still provide performance improve- 
ments after a backup. ZFS brings frequently 
and recently used data to the highest perform- 
ing storage, first to system memory, then to 
caching devices, allowing for flash media per- 
formance without the cost. 


Level 2 Adaptive Replacement Cache 
(L2ZARC) 


Once all the space in the ARC is utilized, ZFS 
places the most recently and frequently used 
data into the Level 2 Adaptive Replacement 
Cache (L2ZARC). The L2ARC is usually larger 
than the ARC so it caches much larger data- 
sets. ZFS will accelerate random read per- 
formance on datasets far in excess of the size 
of the system main memory, which avoids 
reading from slower spinning disks as much 
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The ZFS Intent Log (ZIL) 


ZFS commits synchronous writes to the ZFS 
Intent Log, or ZIL. Super-capacitor-backed 
DRAM as SLOG (Separate) ZIL devices allow 
cached writes to be committed to nonvolatile 
storage so that they are protected in the event 
of a sudden power failure. This allows syn- 
chronous writes to be made at the speed of 
the SLOG device, accelerating write perform- 
ance. 


Determining Cache and Pool Size 


After the ARC, ZIL, and L2ZARC comes the 
hard disks, comprising the ZFS pool. This tier 
is where your data lives and is usually com- 
posed of high capacity hard disks. Perform- 
ance at this tier is the lowest of all, as it de- 
pends on spinning disks rather than flash 
drives. 


lIOPs breakdown: Working Set Size 
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IOPS by Type of Storage 


In order to configure your FreeNAS or True- 
NAS system for ideal performance between 
cache and pool, it is important to determine 
the Working Set Size of your system. Know- 
ing the active data and performance require- 
ments of your storage environment will allow 
you to put together a system that maximizes 
performance. Some questions that can help 
determine the Working Set Size are as fol- 
lows: 


¢ What percentage of your total data 
is “active?” (20% is not unusual)? 


¢ How will the remaining data be 
dealt with? 


¢ One file or a set of data accessed 
simultaneously? 


¢ How many users or 
applications? 


¢ How many people will log 
in simultaneously? 


¢What is the average file 
size and how many? 


¢ What is your workflow? 


¢ What percentage of your us- 
age is read versus write? 


m= 4KB Random Read IOPs =" Expected Max Performance 


Figure 1. |OPs Breakdown: Working Set Size 
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Once the Working Set Size is determined, one 
can select the optimal drive to maximize per- 
formance. In regard to types of SSD cache 
drives, the L2ZARC read cache does not re- 
quire as high performance, as the data is al- 
ready stored on disk and there is no risk of 
data loss. The ZIL requires higher quality stor- 
age devices/memory, as the data has not 
made it to the storage pool yet. In the event of 
a power loss, cheaper flash memory (MLC 
flash) can lose write data. SLC Flash Memory 
devices, on the other hand, do not have this 
issue. 


Conclusion 


ZFS Caching can be an excellent way to maxi- 
mize your system performance and give you 
flash speed with spinning disk capacity and 
cost. FreeNAS and TrueNAS capitalize on 
this technology, allowing you to design a sys- 
tem that fits your needs and leverages the 
caching capabilities of ZFS to their full extent. 


Mark VonFange 
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Model View Whatever - Dolphin 
Smalltalk MVP 


by Damian Czernous 


The Dolphin Smalltalk is a version of Smalltalk language 
dedicated to the Windows platform. The Smalltalk language 
comes with a widget library done with the Model View Con- 
troller (MVC) structure. Dolphin, however, deviates from that 
path. 


In 1995, dolphins at Object Arts start working on a Taligent version of the Model View Presenter 
described in the previous paper ,Model View Whatever - MVP” by Mike Potel. In 2000, in San Di- 
ego, Andy Bower and Blair McGlashan (Object Arts) publish a paper ,,Twisting The Triad - The 
evolution of the Dolphin Smalltalk MVP application framework”. Their roots are strong. In contrast 
to Mike Potel (Taligent version of the MVP), they pay more attention to the communication be- 
tween the view and the presenter. This predilection is not accidental, and comes from the MVC 
experience. It also makes the whole MVP work more complete. 


Taligent company 


This very interesting company was founded in 1992 as a part of agreement between Apple Com- 
puters and IBM. The idea was to create an object-oriented operating system called Taligent that 
could run on every hardware platform. The history of the company is quite stormy. The system 
never came out. A year after the CEO's death, in 1996, Taligent becomes a subsidiary of IBM to 
be finally dissolved in 1998. Some refer to Taligent as an example of project death march. 


During these six years, however, Taligent creates CommonPoint that could run on any modern op- 
eration system, e.g. AIX, HP-UX, OS/2, Windows NT, or Apple OS, providing features like: com- 
pound documents, 2D and 3D graphics, and real-time document sharing and collaboration. The 
company provides Open Class libraries for IBM’s VisualAge, and Java WebRanner. They license 
key Java and C++ technologies to partners such as Sun, Netscape, and Oracle. 
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A number of Taligent classes live inside Sun’s Java Development Kit (JDK). The work of engi- 
neers result in more than 300 patents. The company behaves more like a decent university with a 
number of pioneering projects that influence the work of many industry partners. Thank you, Tali- 
gent engineers. 


Application Model lesson learned 


VisualWorks Application Model enters the stage in the 90’s. The MVC developed by Xerox Parc 
(by Trygve Reenskaug) seems to be interesting for ParcPlace engineers. They create a version of 
Smalltalk platform called VisualWorks that can run on many operating systems long before Java. 
For the GUI, they create a variation of Presentation Model (described in a paper “Model View 
Whatever - MVC’s model evolution”) called the Application Model. 


The Presentation Model implements an idea of separating widget states and stylings from the ap- 
plication domain. The structure makes the original MVC more front end friendly. The Application 
Model introduces Property Objects that make widget to model mapping a bit easier. 


The Property Objects allow widgets to observe the model using Observer Synchronisation mecha- 

nism. That requires additional and unwanted widget implementation. The result is that the Applica- 

tion Model manipulates widgets directly. For Dolphin, overcoming such edits in MVP becomes im- 
portant. They look for a chance to discuss 
how the presenter should control the 
view. 


Supervising Controller 


L.l:processPesel 


1.1. L:validatePesel 


—— 
1.1.1. L:validate 


1.1.1.2:hlisplayPeselError 


1.1.2:fillBirthDate 


1.1.2. L:extractBirthDate 


1.1.2.2:displayCitizen 
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The term was coined by Martin Fowler in 
his GUI Architecture work. As a result of 
the discussion, Bowler and McGlashan 
end up with the presenter that handles 
user actions and ,more important” view 
logic. The ,less important" cases, how- 
ever, are administrated (using declarative 
paradigm - see the marked parts of the 
code below) by the presenter, and are im- 
plemented inside the view (Figure 1). 


Figure 1: A controller that supervises a view. 
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More vs less important view logic 


Validating an entered PESEL number and extracting a birth date to the age field (Figure 1) might 
be seen as a more important than displaying a hint for a field. The assumption is that a Polish 
user might be disappointed calculating manually the age or saving the wrong PESEL number, but 
may be fine without seeing a hint for the well Known Polish national identification number (PE- 
SEL). The more important view logic is the one the user will not want to live without it. 


This interpretation is not the one implied by Martin Fowler in his description, but | found it more 
practical. Martin talks more about complexity of an algorithm itself rather than its importance. 
Thus, the more complex view logic remains within the presenter. The simple view logic in the 
view. 


public class ProcessPeselAction implements 
Property.ValueChangeListener 

{ 

private final CitizenSignUpPresenter citizenSignUpPresenter; 
@Override 

public void valueChange( Property.ValueChangeEvent valueChangeEvent ) 
{ 

citizenSignUpPresenter.processPesel (); 

} 

} 

public class CitizenSignUpPresenter 


{ 


private final CitizenSignUpView citizenSignUpView; private PeselVali- 
dator peselValidator; 


public void processPesel () 


{ 


GUI 


if( Objects.nonNull( peselValidator ) ) validatePesel(); f111Birth- 
BelicetQ)# 


} 
jowlodkake: \icoaliel) srchiliksulreelalbyehneen(() 
{ 


Citizen citizen = citizenSignUpView.getCitizen () ; 
citizen.setBirthDate( extractBirthDate( citizen ) ); 
CitizensvoqnupVaiew, displayCitizen( cra zen ); 


} 


Priavate String extrac tr Ba renDate (sC1bizen citizen) 


Citizen.extractBirthDate( citizen.getPesel() ); 


Citizen.DateFormatException e ) 


void validatePesel () 


ye 


} 


catch( PeselValidator.PeselValidationException peselValidationExcep- 


iene lab 
{ 


citizenSignUpView.displayPeselError ( 
peselValidationException.getReason() ); 


View logic is not a business logic 


Different Uls may have different view logics for the same business logic. The same application 
may have web UI, mobile UI, desktop Ul, command line UI, printer interface, etc. Each may use 
business logic to get a job done. The business logic stays apart from any MV\* structure. It does 
not belong to the front end part of the application. User authentication is an example of the busi- 
ness logic, and at most should be called by the controlling part when needed. 


Potel’s way and Passive View 


Testability is an another way of thinking around Supervising Controller mechanism. Mike Potel 
does not say much about the view/presenter communication. That means that the whole view 
logic may stay inside the view. The view objects are usually difficult to test due to the number of 
bindings to the widget framework. 


The Supervising Controller keeps essentials separated from the view thanks to the declarative 
communication. That makes the presenter’s view logic fairly easy to test, and the less important 
parts most likely untested. The Passive View18 approach, however, moves the entire view logic 
to the controlling part making it almost fully testable. The cost of that is the complex controller that 
imperatively communicates with the view (see the code on the next page). 
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public class CitizenSignUpPresenter 
{ 


private final CitizenSignUpView citizenSignUpView; private PeselVali- 
dator peselValidator; 


{ 


String pesel = citizenSignUpView.getPeselTextField().getValue(); 
String birthDate = extractBirthDate( pesel ); 
citizenSignUpView.getBirthDateTextField().setValue( birthDate ); 


} 


public void validatePesel () 


peselValidator.validate ( 
citizenSignUpView.getPeselTextField().getValue() ); 


} 


catch( PeselValidator.PeselValidationException peselValidationExcep- 
Eton 1} 


{ 


Notification.show( peselValidationException.getReason() ); 


In next paper 


In the age of small modules, or thinking about software as a combination of small pieces, engi- 
neers notice that writing the controlling part is more about code plumbing than coding the mean- 
ingful view logic. The web applications are everywhere. In a short time, the controlling part will dis- 
appear, and the view logic will find a place much closer to the model than ever before. Have a 
look on Model View Whatever - view and two models 


About the author: 

Damian Czernous 

Reasoning about software architecture fascinates 
me for 10 years now. 

Lead Engineering Coach at Nokia. 


www.sanecoders.com, @DamianCzernous 
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PRACTICAL PYTHON WORKSHOP 


PEDRO ARAUJO 
& RUI SILVA 


on Oe mas (kate, ged Dietketsy a 
: .% 4 
~*~ How to ae Hello forid, from in- 
terpreter and with .py script. 


° Standards and batteries included 
° Standards and PEP8. 


° Batteries included (just to show the 
most useful python core libraries and 
link to the official documentation). 


“Python dal eh ad thy Ve ea tes get A tters , 
vn pt Pd. } set kin 


Poked Exceptions handling > 6 
oan oe 

7 Practical seit: 
. Use twitter’s API to get some data 


and show it in the console 


Module 3 (files): 


* Files 

¢ Duck typing. 

¢ Opening and reading from files. * Csv files 
and csvreader. 

¢ Practical exercise 


INTERVIEW 


Before you start, you have to have a 
passion that borders on obsession... 


Giuseppe Canale from Escom Net 


by Marta Ziemianowicz, Marta Strzelec & Marta Sienicka 


[BSD Magazine]: Hello Giuseppe, how have you been doing? Can you introduce yourself 
to our readers? 


[Giuseppe Canale]: Hello and thanks so much for having me! To give you a little background, I’m 
a small business owner in Northern Italy - specifically in Alba, which is about 45 minutes south of 
Turin, where the 2006 Winter Olympics were. | got into it at a time when, at least in Italy, IT hardly 
existed. My first experience on the net was with a Commodore 64 and a modem with a 300 baud 
rate (1 Bd = 1bit/s) and a ITAPAC (X.25 protocol) connection. In fact, when | went to college, | 
knew | wanted to major in IT, but it wasn’t even possible - the course didn’t exist! So | majored in 
mechanical engineering and did a lot of independent study outside of school. 


After | graduated, | started off selling hardware - this was in 1987 and quickly thereafter, | got into 
software development. In ‘97 | opened up my own company. It was an exciting time in technology 
- e-commerce was just being invented...but Italy was and continues to be somewhat behind-the- 
times when it comes to IT. 


[BSD Mag]: Do you know why Italy is behind when it comes to IT? 


[GC]: Technology had two phases: pre and post internet. And for Italy, the post-internet phase is 
what created the problem. The Internet requires a connection and for a series of motives, princi- 
pally geographical, but also logistical, Italy is difficult to physically connect. Besides the fact that 
we have lot of mountains, and hilltop villages and the majority of our towns are ancient/medieval, 
it's hard to find a town or village in Italy that isn't a historic center of some sort. So, digging to lay 
the lines is a problem - you either need to tunnel through massive quantities of rock, deviate 
around mountains or avoid destroying unrecoverable historic artifacts. Often, when they actually 
decide to attempt installing lines, they uncover some archeological ruin and all work stops indefi- 
nitely. Also, since the towns were designed so long before even electricity was developed, the cit- 
ies weren't created with urbanization in mind. In many places, even installing running water and 
central sewage was a major problem. These are the first huge obstacles that we're still trying to 
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INTERVIEW 


[BSD Mag]: Can you tell us something about the company you work for, Escom Net? 


[GC]: | like to think of my company as a sort of laboratory rather than a traditional office. Our core 
focus has changed over the years to respond to changing technology (from hardware, to soft- 
ware, to mobile, e-commerce, social media, security...). Continuing education is very important to 
me and to my business partners - we're constantly doing research, reading the latest tech news 
and developing projects to try out some new strategy or put our new found skills to the test. 


[BSD Mag]: What will be, in your opinion, the “next big thing” that we’re all going to have 
to educate ourselves about? 


[GC]: Protecting our digital information. We haven't really comprehended the importance of pro- 
tecting our digital property yet. We'll go to great lengths to protect our physical property, but defi- 
nitely haven’t matured to as strong of a protection with our digital data. 


[BSD Mag]: You are a software Developer, a Project Manager and a Security Specialist. 
Which experience do you find the most useful on the labour market and what do you like 
to do the most? 


[GC]: Overall, | find the security specialist experience the most useful. A strong security back- 
ground can help you be a great software developer or a great project manager and is useful even 
in everyday life — because it forces you to look at things from an outsider’s point of view and ask 
- how can | do this better, how can | make this stronger, safer, more secure? Security is an argu- 
ment that pervades all aspects of an organization and is an important part of our personal safety 
as well. So, while software development and project management are useful skills, IT security is 
something that pertains to everyone, everywhere (unless they’re living completely off-the-grid, 
and even then | think | could identify some issues that would affect them). 


[BSD Mag]: Where should | start if | wanted to become a security specialist? 


[GC]: Before you start, you have to have a passion that borders on obsession. InfoSec more of- 
ten than not requires a certain mentality - it’s not just about having strong technical skills. | don't 
think there is a real starting point with this industry - it’s an epiphany you have to have - start by 
falling in love with the topic. 


[BSD Mag]: What do you think about being experienced in different fields of business and 
science? Is it more for self-development or it is a must-have skill nowadays? Or maybe it 
is better to be an expert in a very narrow area? 


[GC]: Excellent question and my view on this goes back and forth over the years. Right now, | 
think that it’s better to be an expert in one field. It’s better to have certified proof that you know a 
certain topic well - especially if you’re job hunting or have any intention of changing jobs in the fu- 
ture. A certification from a reliable authority makes it that much easier for someone 
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| think that’s part of the problem we're seeing today in the job market - it’s difficult to accurately 
measure people's skills. What people write on their resumes and the truth of the matter are often 
very different realities, even if we're trying to give an honest representation of our skills. Our indi- 
vidual understanding of a degree of knowledge can vary greatly and having a certification, like the 
CISSP certification that | have, for example, which requires five years of proven experience plus 
an intense and challenging exam, as well as proof of continuing education credits for as long as 
you hold your certification, goes closer to an accurate form of measurement. And though | can cer- 
tainly understand the benefits of having a broad level of Knowledge on a variety of topics, | think 
in the future, when lower-level positions will be automated, very specialized knowledge and rea- 
soning skills - like only humans can do - will be more sought after in the global marketplace. 


[BSD Mag]: As you mentioned previously though, having a few different reference points - 
like having project management experience - can enrich your work. In that case, which 
field would you recommend for IT security folks, who don’t want to diverge too much from 
their narrow specialty, but would like to get a different perspective nonetheless? 


[GC]: Let me specify that, for managerial roles, it’s essential to have a broad range of knowl- 
edge, you NEED to have an understanding of a wide range of subjects, and even if that knowl- 
edge doesn't go deep, it gives you an overall perspective that someone with a single, narrow con- 
centration probably doesn't have. 


For those that want to gain perspective, | think the best way would be work on interpersonal rela- 
tionships and staff education. Most security problems are a result of people not being informed or 
aware that their behavior is a threat to security. Having the skills to effectively generate aware- 
ness - both within the company and with clients - can be a huge security advantage. 


[BSD Mag]: What about open source software? Are you an enthusiast of any of them? Do 
you work with them on a daily basis? 


[GC]: Mmmm, open source. | have mixed feelings about open source. | do work with them on a 
daily basis - Wordpress in particular, | have a lot of experience with. Open source has its pros and 
cons...| sway towards a negative opinion of open source because so many of them - in order to 
protect themselves - are written in an extremely convoluted manner. Yes, the code is open, but 
the developers often incorporate a seeming endless (and, oh-so-vicious) chain of functions that 
call other functions that call other functions, that if you actually put your hands on the code can be 
an extremely frustrating and time-consuming experience. If all open source software were written 
Clearly, logically, without unnecessary convolutions and complications, | would be a great propo- 
nent of open source. But more often, when I’m dealing with open source, | feel frustrated, disap- 
pointed and angry. 
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[BSD Mag]: If you had a chance, what would you change in open source software to make 
it less frustrating? 


[GC]: | don’t think there is a real solution to this problem without changing the very nature of 
Open source, and that would be counter -productive. One of the biggest advantages of open 
source is that it’s free - and if you want that advantage, you have to put up with everything that 
goes with it. Unfortunately, a lot of the small/medium sized companies that might be turned on by 
the economical benefits of open source may not realize the limits they’re opposing on themselves 
by doing so: that you accept the software as-is, and unless you’re using the software on a very 
simple level, it’s going to cost you more than you might imagine to implement it for your purposes. 


An approach to improving open source might be to work towards code standardization - so that 
programmers can more quickly and easily manipulate the code for their needs or creating better 
documentation. 


[BSD Mag]: | found out that you have experience in Windows NT security implementation. 
What do you think about all of the problems with Windows 10? Do you work on Windows 
10 yourself? 


[GC]: Windows, another topic which | feel strongly about - hopefully this interview doesn’t make 
me sound like a grumpy, negative techie. :) About six years ago, | made the switch from Windows 
to Apple and, though it may sound cliche, | have to say | will never go back. This doesn’t mean | 
no longer interact with Windows, however (unfortunately - haha). | choose not to work on a com- 
puter with Windows 10, but | have it installed on Virtual machines for testing and laboratory pur- 
poses, etc. And obviously many of our clients use Windows. To give you an idea on how far be- 
hind Italy still is - some of the clients I’ve recently done consulting for were still using Windows 
Server 2003! Woe is me. | think Windows made some interesting (read: ballsy, egotistical) 
choices while developing their security policies for Windows 10. It certainly doesn’t seem like 
they’re really putting the safety of their clients at the forefront. 


[BSD Mag]: What makes Apple better than Windows in that regard? 


[GC]: The first thing that makes Apple better than Windows in regards to their putting client safety 

first, in my opinion, is the App Store. All apps available for download are guaranteed by Apple and 

reviewed before they are accepted by the store. Apple has extremely high expectations and a 

strict and complex selection process which filters out malicious developers. If there’s ever a prob- 
lem with an app after it's been added to the store, Apple can quickly remove it. And even if you 

don’t install an app directly from the store, Mac’s Gatekeeper protects you from inadvertently in- 
stalling malicious software. 


The App Sandbox in OS X isolates apps from the critical system components of your Mac, your 
data and other apps and helps ensure that apps only do what they’re intended to do. 
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Would the people in the pictures you publish really be okay with having their image splashed all 
over the web? The decisions you make about protecting your PIl - take a few minutes to really un- 
derstand how they’re protecting your information and your rights, the way you interact with agen- 
cies and organizations that have access your personal information. Evaluate your web presence 
and take steps to make yourself, your family and your friends safer. If you are in IT - share your 
knowledge about IT security with others in a way that’s easy for them to understand. 


About Giuseppe: 


Giuseppe Canale is an IT professional and entre- 
preneur based in Northern Italy. Having dedi- 
cated over 28 years to the industry, he has the 
unique advantage of having experienced first 
hand the evolution of digital technology - starting 
with the Commodore 64. A Certified Information 
Systems Security Professional (CISSP) specializ- 
_ ing in cyber security, Giuseppe began as a pro- 
grammer and eventually opened his own IT con- 
sulting company in 1997. In recent years he has 
dedicated himself more specifically to IT security. An avid long-distance runner, 
when he’s not researching the latest threats and vulnerabilities or developing secu- 
rity policies, you'll find him on the track. 
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The International Consortium of Investigative Journalists, 
German newspaper Suddeutsche Zeitung, as well as more 
than 100 other news organizations, have caused an interna- 
tional storm by releasing the Panama Papers this week. 
There is a very large fly in this ointment however. Why is 
this 2.6 Tb dataset of over 11 million documents not being 


released in its entirety? 


by Rob Somerville 


Just about every mindful adult who has read 
the news this week concerning the biggest 
leak in history (so far) will not be at all sur- 
prised by the initial content floated in the inter- 
national media this week. Banks, lawyers, and 
the men in grey suits behind the scenes facili- 
tated tax avoidance schemes for a privileged 
few; while the rest of us dutifully pay our taxes 
— often under the threat of bankruptcy or 
prison if we default. As the old saying goes, 
the difference between tax avoidance and eva- 
sion is 10 years in jail and a $100,000 fine; 
yet it is still to be seen if any of the conspira- 
tors (both legally and in reality) will face a trip 
to a dank, damp prison cell. Like a fish rotting 
from the head down, the stench and level of 
corruption the Panama Papers exposes turns 
the stomach. But what has this to do with a 
technological magazine? 
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A lot. First, the sheer scale of the dataset is 
huge. 11.5 million documents. It is larger than 
many archive collections found in national mu- 
seums. This would have been difficult to leak 
10 years ago, and well-nigh impossible 50 
years ago. In 2016, you can fit this all on an 
external drive smaller than a paperback book, 
or if you have $1,500 to spare, it almost fits on 
a couple of 1TB USB drives. The exact tech- 
nique used to extract and transfer the data is 
currently unknown (it may have just been 
FTP'd from the offices of Mossack Fonseca) 
but any security conscious whistle-blower 
would be cognizant of the risks no matter how 
it was transferred. Without the leverage of 
technology, this incident would not have hap- 
pened. Was it a hacker? A disgruntled em- 
ployee? A lawyer with a conscience? Time 
may tell, but whatever the scenario the perpe- 
trator of this act must have nerves of steel. 
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Second, there is the ethical and moral consid- 
erations to be factored into account. Far be it 
for me to criticize the IClJ, who have per- 
formed sterling work in bringing this whole 
shady affair into the spotlight, there is a much 
bigger question here. While the right to pri- 
vacy is enshrined in law in most jurisdictions, 
how can this be reconciled with the damage 
done to society when the evidence of such 
large scale hypocrisy and potential criminality 
— to use an American legal term — is Fruit of 
the Poisonous Tree? 


Two wrongs do not make a right, and it could 
be argued that as this information was ob- 
tained illegally, it should be destroyed. After 
all, as individuals we would not be very happy 
if our medical or financial records were re- 
leased to the press. 


What is challenging about the whole scenario 
is the knife edge walked between the public 
good and personal interest. No doubt, 
amongst the data set there will be perfectly in- 
nocent information that would cause distress 
if it were be to be published. This, along with 
the libel laws, is the main plank of the journal- 
ists' case to maintain control over the data 
while they process it. If given to lawyers and 
courts to deal with, the time-scales and costs 
to analyze, review, and prosecute would be so 
excessive that litthe would be achieved. The 
same could be said of national tax agencies. 
So there is an ironic expediency to have a trial 
by media, as the quickest way to slide down 
the greasy pole of power to a severely dam- 
aged reputation. However, this introduces a 
another factor — political and financial bias. No 
matter how professional the paper, they will 


have their own agenda, a particular spin they 
want to put on the ball. And advertisers. It 
seems terribly coincidental that at a time 
when the West is going all out to discredit the 
Russian President, that he has been the main 
focus of this leak in the Western media, de- 
spite his loose connections with the Russian 
individual named. 


If | were a judge, my response to all of this 
would be to release all of the data into the pub- 
lic domain on the basis that a million pairs of 
eyes will get to the bottom of this sordid story 
a lot quicker than any team of journalists, no 
matter how talented or dedicated. Applications 
could be written (like Seti at home for in- 
stance) to data-mine, find patterns, and ex- 
tract the relevant facts. 


While this might seem like an extreme posi- 
tion; However, if the little detail that has 
emerged so far is anything to go by, | believe 
there are many more dirty little secrets buried 
in these documents. Redressing the amount 
of damage inflicted on society (especially in 
these times of austerity) far outweighs any in- 
dividual right. You might argue that you have 
done nothing wrong, and | would be the first 
to argue for your right of privacy and confiden- 
tially in normal circumstances. But these are 
not normal circumstances. 
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50 years ago, it was the exclusive domain of 
the safe cracker, spy, thief, and charlatan to 
gain illicit access to confidential information. 
While sensitive information was stolen, the 
physical amount was limited to photocopies or 
what could be captured on a high-resolution 
miniature camera. Today, any script kiddie has 
potential access from his bedroom or base- 
ment. Organized crime is leading the charge 
in capturing data on an unprecedented scale, 
albeit for their own nefarious ends rather than 
the public good. Prior to this scoop, we had 
not seen anything yet on this scale, but give it 
a few more years and it will be quickly sur- 
passed. More and more data is being mi- 
grated to the cloud, and huge datasets can be 
cloned in minutes. At the press of a key or a 
click of a mouse, this can be made available, 
replicated and distributed with ease. As a Soci- 
ety, we need to work out a solution to the ethi- 
cal issues and moral quandaries the actions 
of whistle-blowers and indeed hackers raise — 
and quickly. If not, when the next big exposure 
happens, the journalists and lawyers will still 
be digging their way through the fine print of 
the Panama Papers. 
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